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ABSIRACT 

Two experiments are conducted to observe how 
children, ages 10-15, who have not previously used a computer, will 
learn concepts relevant to computer programing languages. The 
interpreters used are LOGO and SIMPER. Subjects are pretested with an 
instrument developed to predict ability to manage the concepts. They 
are then given group instruction on a weekly basis with individual 
practice four days a week. Teletypes, for the most part, are used to 
interact with the computer, and tutorial assistance is given. After 
the first experiment the order of presentation is altered. The 
results of both experiments lead to the identification of changes 
that are needed in the interpreters and to suggestions for further 
revisions in curriculum design. The report is supported by tables, 
and by appendices including a third interpreter, SPM, and aptitude 
testing details. (HEC) 



*:^j|;;(t:^s:<c**:?c«***3?t******3^.^*jK* ******* ********* 

* Documents acquired by ERIC include many informal unpublished * 

* materials not available from other sources. ERIC makes every effort * 

* to obtain the best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions ERIC makes available * 

* via the ERIC Dccuirent Reproduction Service (EDRS) . EDRS is not * 

* responsible for the quality of the original document. Reproductions * 

* supplied by EDRS ar€ the best that can be made from the original. * 

3* ;»t;>***3}:* ********************************************** ******** 



ERIC 



f\l 

^ EXPERIMENTS IN TEACHING 

Q CHILDREN COMPUTER PROGRAMMING 

LU 

by 

A, B. Cannara 



TECHNICAL REPORT NO. 271 
May, 1976 



PSYCHOLOGY AND EDUCATION SERIES 



Reproduction in Whole or in Part Is Permitted 
for Any Purpose of the United States Government 




INSTITUTE FOR MATHEMATICAL STUDIES IN THE SOCIAL SCIENCES 

STAI 'iiO UNIVERSITY 



STANFORD. CALIFORNIA 94305 



U S DEPARTMENT OF HEALTH 
EDUCATION A WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

^^'S OOCUMfNT HAS BEEN REPRQ. 
OUCED FXACTLV AS RECEIVED FROM 
THE PERSON OP ORGANrZATION ORJGlN. 
^ I'ti^' PO.NTSQp ViEA OR OPINIONS 
^TATFD DO NOT NFCESSARtLV REPRE- 
SENTOfnr:.H N.MIONAL NSTjTuTEQF 
PDUCATIO*. POSITION 0" "OL'.y 



Foreword 



This dissertation is actually an extension and continuation of an earlier 
technical report (Weyer & Cannara, 1975), which lierein is called "report-l". 
Report-1 should (but need not) be read in conjunction with tliis document. 

As a matter of notation, all phrases in the text that are not in Englisli, 
but in the computer languages being discussed, are surrounded by single quotes 
(*), unless their context is otherwise obvious. As a matter of taste, which 
rejects the "arrogance of the acronym", names of programming languages and 
otlier proper nouns, excepting trade or institutional names, receive their due 
quota of capitals— one. 

Several references are made to articles in a few connnion periodicals, not 
necessarily because the articles are uniq ue ly relevant, but because the 
periodicals are ?asily found and their editors traditionally strive for clarity as 
well as accuracy. 
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1. Introduction 

Heroin tire discussod in detail two oxi?oriincnts done at the Institute for 
MatluMnaticnl Studies in the Social Sciences (IMSSS) at Stanford during the 
summer of 1973 and the spring of 1974. PrcvioMsly, Cannara and Weycr 
(197-la), and Weyor and Cannara (! ), have described the 1973 experiment; it 
will be referred to as the "first" experiment. The 1975 document will be 
called "report- 1". 

The experiments attempted to study children, who haa never used a 
conii)uter before, learning: (a) concej)ts relevant to computer programming, and 
(b) modern programming languages. The languages and other programi.iing 
facilities used (e.g., graphics) have been discus.sed definitively in report-1; this 
thesis will simply outline their features and concentrate on observations of the 
childrens' learning-processes and the implications of both experiments in terms 
of prograniming-langnage and curriculum design, and tutoring technique. 

Why observe children learning computer-programming? Programming would 
seem to bo a decidedly adult task for young people who haven't yet completed 
their basic. schf)oling. A partial, motivational answer follows immediately; the 
remainder of this thesis may be viewed as an attempt to ct>;riplete that answer. 

Tlu'^e main streams of thouglit converge on the study of children learning 
to use a computer. First, is the view that a computer is in /'ul a tool for 
thinking, which implies that it might be applied fruitful at eve^-y educational 
level (e.g., lirown & Rubinstein, 1973; Dwyer, 1972; Feurz( Papert, Blofrm, 
Grant & Solomon, 1909; Kay, 1972[h]; Papert, 1970). In particular, the 
computor can be us. 1 to stimulate the activity Papert has referred to as 
"tl wig about thiiiking". Second, is the desire of some educators to study the 
thinking processes of people solving T>roblems (e.g., Bloom & Broder, 1950; 
Piaget. 1970; Polya, 10r)7), which leads directly to studies in perhaps the most 
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yoiuM'iil prol)l(Mii*solvni|; rriilm* (.'t>in{)utor pr()g^a^^Ili^^^ Thirci, is a syiithosis of 
liinriiui probliMti-solviMg and roinpiitor as-tool, fiainl^oyautly naniP(i "artificial- 
int<»lligcnco rosoarch", v.hicli aims to fonnalizo prohlfMii-solvinf; procochiro.s (o.^., 
FoiK(Mibaiim & I'Vldniaii, 19l)3; IVIi:;sky, 1*^H)8; Nowoll <t Siinor., 1972; Nilson, 
1971; Wiiiograd, Ur/1). SonnMiines, artificial-iiitolligence procliicts can better 
our inuior.staiuling of onrselvos and/or provide useful oducational strategies (e.g., 
Brown & Burton, 1974; Goldberg, 1973). 

We sbouid not be sur|)rised to find fliildren and computers where those 
three streams intersect. The 'nliicational Hnkage of computer programming witli 
thinking is expressed by the idea if a "mathematical laboratory", in which a 
program creates a constructively interactive, and so perliaps more interesting 
environment for learning. Unlike most traditional ri.Mli/,ations of coniputer- 
assisted-instruction (Cai), the laboratory is designed to "understand", at a 
meaningful level, the domain of interest.^ Unlike most clas.^.room lectures, such 
a laboratory can give substance to the material and exploratory freedo.n to its 
users. The user's interaction witli a mathematical laboratory is meaiated by a 
formal (as opposnd to natural) hmguage, whose semantics access the constructive 
abilities of Uie laboratory and whose syntax is simply a perhaps novel set of 
conventions. A computer and a programming language together constitute a 
matliL^matical laboratory of the most general kind, because they are all that are 
needed to construct (simulate) any other laboratory. That is the main 
justification for studying progrannning as a general problem-solving activity. It 
is based upon a conjecture of Church's that (freely interpreted) suggests that 
any ideas which may be fornuilized may be studied as a computer program, 
Forniali/.ation of ideas, a fundamental aspect of mathematics, is part and parcel 



^S'?f.' LHis (lO/'l) nr ()♦.' 1. 1 ni()»-f nnd Mm Irs (1 »*■}), for rriti(jue<', of f)roSf^nt tMlucationnl 
h i s f.'ii' I (. ,1 1 1 y Ly(:^'.«l r ^ .i. i, ' ; '. i»i (.-n. 

^foi ill s cur, :i ion:; ot ''it.rch's th(->»s. :.oe M;.nn^ (10/?) or Minsky (1*J»3;). 



of niallirr.utiral laI)()r;ilori<\*. for ;M-()f;raniiniiiK. piobl^Mii .solviii^^ and tlunkiiiK 
about tliinkiiig. 

The proilurlioii of offoclivo nijUlnMnatical lahoratorit s is closely and 
bidirrctioiially coiinrctod with artificial-inltdligence work and human self- 
undel\stan(hn^^ It must grapple with (|U(\stions hf?yoncl the innn(uliat(^ scopr of 
tho hiboratories thomstdves. Eff(n:tivo tutorinj? tochnicpies, for o laruple, aro 
educational objoctivPii which nnist bo attained even after one has constructed a 
hiboratory wliich "understands" its (h)main. Thus, applying tho computer 
educationally, as a tool matlo available via a laboratory, doniands answers to 
cpiestions posed in a wide variety of fiehls (e.g.. Brown & I]uvtou, 1974; 
Goldberg, 1973). 

The th(?ory and practice of computation offer educators me vahiable looks: 
(a) the formali/.alion of ideas as clustered secpiences of instructions, (b) methods 
for modelling real-world processes, and (c) metaphors for undtirstanding maclune 
and human information-processing. Together, these expose thinking tecliniques 
that Papert has tenutn^ "powerful ideas". Concepts of programming and 
thinking can be taught as naluriM and inseparable partners, emphasizing 
studento* scrutiny of their own thinking :^bout the world. And, it is not a new 
idea that school-children can and should Icrn how to program a computer, so 
tl\at the> too might access its unparalleled power as a tool for thinking. The 
computer's natural ability to simula e has responded to tho ingenuities of 
studetits fas seen, for example, in tie work of Hrown and Rubiristein, Dwyer, or 
Papert) with the same spectacular generality it has provided to professional 
researchers (e.g., Levisou, Ward & V^'ebb, 1973; Toomre & Toonn'o, 1973; 
Winograth 1971). 

The roregoing remarks were intended to justify a desire to study 
progrrunmiug >is an intellectual activity for children and programming languages 
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as t(M>ls for such urtivily. As a tcclmolof^ical prothut, ihv pprsonai rompntor 
win soon 1)1^ as iiiurh a rrality, as tlu' jxMsonal calfiilator is today. Access to 
inttM'act i v(^ compulation may nooii become f-omuu)nj)iac(^ for vast numbers of 
chihlren (and aiiiiits), at scli»)t)l or at houuj. Certainly we should l)e trying now 
to luulerstanrl how to hone this new tool to nujxinium usof\jhu:ss. As a medium 
for expi't\ssinj;, manipulating arul rouinuuiicating ichMis, the personally accessihie 
couijaittir may stand w<dl aht)ve everything' ;;ince the printing press.'* 

Teaching progriMuming is a tiitorial endeavor of perhaps the most general 
kind. Tlu? work to he reported here atttMupts to cliaracteri/.e some of the 
situations that human and nuvdianiral tutors for Tvo.M'anuuiug will confront and 
niiiSt bo prcjjariHl to resolve. It is relevant t' rnrnon ground between 

(uhicatiori and artificial intelligence because th( : action of computer 

progrttrus which can tutor luniians with human proficii»ncy is a conimoti goal. 
No one h.is attained that goal yet, because the activities of a good tutor are 
tied irrevocably to huruannoss of language and knowdedge (e.g., Wiriograd, 1974), 
Although the theoretical power of the computer (i.e., as conjectured by Church) 
may be sufficient to simulate natiiral inti Uoct, we do nc ' yet understand 
oursidves for otiier species, e.g.» Gardru^r & Gardner, 1975) v/ell enough to 
communicate evcMi a coarse description of intelligence to any recipient (note the 
arguuients of Stcptj 1975a, 1975b; and his critics). Those who have recognized 
the natiire of this problem have conu.' closest to success in cu'efuUy limited 
contexts {e.g..^ Brown & Burton, 1974; Carbonell. 1970; Winograd, 1971). 

The generality of a programming laboratory and the intinuicy of tutoring 
combine to produce an interesting research environment in which analysis of 



<'^*> K-iy If.'.Mj) Of Ur-UKl (I'l/'l. ;>{> . L-l /I) for nur . i-w of t.hr? n»Mr 

f !jt uf <} of co'Mpui 1 ni'i , 

f.MiH.tiPl ^ vl<- \ / ' :^\'.ur ^ fn/)). a.Mj Maii'.hly f1>/f') fnr hr, !nri(,il p.-fi-'t on 
r.fi" f ';:n{ni I -.'f* ' s I m()::i.' ii ?, , .iiid V.n roiix {{)/'<) for d ic -m, t Mii I, ti.U l e (. Ii no ! ■ hj ic d 1 event'*' 

M'i} t. .ik 1 mj now . 
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errors plays a central role. A programming tutor (human or mechahical) must 
be ready to intelligently suggest, accept or comment on an arbitrarily wide 
range of student interactions and program syntheses. The details of errors do 
more than indicate what a student does not understand, they indicate how the 
student views the problem at hand in terms of his or her own view of the 
world. 

Extending a suggestion of Papert's, if a student responds to a posed problem 
at all, that response is typically correct by the student's person.il analysis. So 
the student is surprised to hear "wrong". It is the tutor's responsibility to try 
to divine the reasons for the student's error, perhaps acting as does a detective 
eliciting evidence from someone from a foreign land— subsequent interaction is 
devoted to laying a common foundation of terms (definitions and relations). 
The tutor necessarily learns about the student's world view and is better 
prepared to handle future errors and future students. Errors are not "bad", 
they provide valuable feedback to be exploited for student benefit.^ 

However, any tutor (human or mechanical) for teaching something as 
£ neral as programming is destined to occasionally fail the student, because it 
must occasionally tackle unsolvable (uncomputable) problems.^ In other words, 
the tutor must pass judgment on the correctness of a student's program, and we 
know that there exists no general procedure for deciding that an arbitrary 
program is correct or incorrect. But the range of solvable problems is so broad 
that this hard theoretical fact discourages neither researchers nor teachers. 
"Proof of program correctness" (Hoare, 1971) and "automatic program synthesis" 



*'^rhis rf?lnt.L'S to n bar. ic criticism of most past efforts in Ca i : not only hnvi? profjrn'ns 
l)ef?n (ItjsiyntMl which fail to uinhirs tand their own suh jfjc t -ma t tor . they fail to possGSS 
more than trivial er ror - h arul 1 i iig strat^Mjios. Results too often have been jusl transfer 
of programinod instruction text or film fj computer storage, using vtjry little, from the 
student's vantafje. of th«> cf)m()u te i- * s com()iita t iona 1 potential. Dwyer has said that Cai 
fails in "reproducing the excitement of masterful teaching", I would add that rai-ely 
have Cai w<.wkei-s even ntte'opted to capttii'e masterful teaching. 

"Discussions of the uncom()utat) 1 e (unsolvable or unprovable) appear in 13avis (1005). 
Minsky (10»W), Chaitin (I'J/f)) «Tnd Steeii (1975). 
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(Feiiichel, Weizonbaum & Yochelson, 1970) are active topics in computational 
research which have clear bearing on future success in constructing competent 
computer-based tutorial systems. 

Numerous research projects have taught children particular programming 
languages (e.g., Feurzeig and Lukas 1972a; Fischer, 1973; Folk, Statz & 
Seiciman, 1974; Milner, 1973; Roman, 1972). However, apparently none has 
attempted to make explicit tlie broad range of relevant programming concepts 
and tlieir relationship to a student's world of thought. In such terms, many 
projects have pursued hazy, sometimes arbitrary goals that concentrated on 
teaching an available language through ad-hoc, problem-solving situations, 
without generalizing situations and solution strategies. A study by Folk, et aL, 
(1974) is perhaps the most extonsi\i attempt to specify relationships between 
programming concepts and children's thinking processes. But their analysis is 
confined to classical statistical models and the concomitant testing of rather 
broad hypotheses virtually ignorps a wealth of detail in student protocols. 

In contrast, protocols (and tutorial notes) are precisely the data upon wliich 
this work is founded. The primary objective is to understand how cliildren 
learn programming concepts (e.g.. Table I), witli secondary emphasis on the 
influences of languages and curricula. With error-analysis as a tool, 
student/machine interactions must be exposed in as much detail as possible. 
Narrow views, provided for example by conventional test scores, are inade<.;uate 
no matter liow convenient tliey may be to obtain and analyze. Quoting Bloom 
and Broder on the subject of "objective" tests: 

"Wliat is missing is information on the process by which 
the pro})lems are solved. The methods of attack, the steps of 
the thinking process, the kinds of considerations used to make 
one choice rallier than another, and the feelings and attitudes 
of the subject are neglected or given very little attention. 

"... attention on the processes of thought.., may also 
require a change from testing and mass studies to those which 
involve small numbers of subjects studied by rather intensive 
techniques. 
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Table I 



Some Fundamental Programming Concepts 

1. Machine as a tool manipulated with a command language 

2. Machine possessing an alterable memory 

3. Literal expressions 

4. Name-value associations 

5. Evaluation and symbol-substitution 

6. Execution of stored programs 

7. Programs which make decisions 

8. Procedures (algorithms) 

9. Evaluation of arguments to procedures 

10. Procedures as realizations of functions (transformations) 

11. Composition of functions 

12. Partial and total functions 

13. Computational context (local versus global environments) 

14. Evaluation in changing environments 

15. Inductioa (recursion and iteration) 

16. Data structures as defined by functions 

17. Problem formulation (representation) 

18. Incorriijlete algorithms (heuristics) 
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"The way in which each student looks at a particular 
task may make it a unique problem for him." 

— Bloom & Broder, (1950). 

It may seem obvious that to understand a physical or intellectual process 
one must exercise and observe it. In fact one must observe what it does 
wrongly as well as correctly before a good model of the process* structure can 
be realized. Thus has error analysis proven its value in many fields (e.g., 
Fromkin, 1373; Newell & Simon, 1972). It is a basic means for evaluating 
cheories in all the sciences. 

"Truth arises more easily from error than from confusion" 
—Francis Bacon. 

This work has depended upon observing children learning by making 
mistakes and discoveries. For their own benefit and for the practical 
requirements of research, the children had to feel motivated and supported. 
Motivation is an essential precursor of effective learning, yet it is often 
snubbed in the analysis of everyday education (Jackson, 1968); and it has yet 
to be captured accurately in artificial-intelligence applications. So, apart from 
examining interactions with a programming laboratory, this work has also been 
concerned with the motivational aspects of tutoring, curricula, languages and 
concepts. 

That programming concepts provide a link between formalized thinking and 
perceived reality is certainly not a new axiom (Berry, 1964). It was assumed, 
perhaps tacitly, in much of the similar research quoted earlier. For motivation, 
a .student should look to his or lier own life experience for applications of the 
tools which an under.standing of pertinent concepts supplies. This is the 
ultimate justification for teaching programming, because the power of a 
programming laboratory derives from the fact that students do more than 
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interact with it, they intervene, and mold the laboratory to their very own 
purposes. 

The research problem can be summarized by two questions: (a) How do the 
characteristics of a p o^rramming laboratory influence a child's motivation and 
ability to learn programming concepts and apply them to the solution of 
problems? and (b) What are some significant features of that learning process? 
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2 Programming Facilities 

Both experiments attempted to impart an understanding of the concepts in 
Table I and fluency in two, very different programming languages. This 
required the development of: (a) interactive laboratories (interpreters) for the 
languages and devices used, (b) parallel curricula for teaching the concepts, (c) 
means for acquiring data on each student's interactions, and (d) means for 
judging each student's aptitude for programming and mastery of the concepts. 

Part of requirement (a) w^^s met easily by using existing interpreters for 
two languages, Logo and Simper, developed specifically to teach children 
computer programming. At one time, a third language (Spm, Appendix 1), 
designed by the author, was also a candidate but was discarded. Development of 
some of the devices used and requirements (b), (c) and (d) defined the work to 
be done preliminary to the experiments. 

Languages 

Tha languages Simper and Logo were chosen because they are 
computationally general, they are relatively easy to learn, they are interactive 
with powerful editing features, and they are highly dissimilar (Figure 1). Both 
are detailed extensively in report-1, so only a brief description is necessary 
here. Both experiments, the first (summer-1973) and second (spring-1974), led 
to changes in both languages—these will be indicated also. In the text, paired, 
single quotes (*) denote items in the Logo and Simper languages. 

Simper was developed by Lorton and Sliniick (1969) at IMSSS as a simple 
sinuilation of an imaginary machine resembling an Hewlett-Packard model 2000. 
It has been used to teach business applications of programming to students at 
Woodrow Wilson High School in San Francisco (Lorton & Muscat, 1975). At 
IMSSS, it lias been expanded and rewritten in the Algol-fiO subset, of Sail 
(Swinohart and Sproull, 1071) by the author. 
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Simper 



Logo 



001 
002 
002 
003 
004 



PUT A 43 
NAME REPEAT 
CWRITE A 
PUT P REPEAT 
RUN 



^TO REPEAT :LETTER: 
QIO TYPE iLETTER: 
Q?.0 REPEAT :LETTER: 
@END 

REPEAT DEFINED 



EXECUTING 1 TO 500 
+ + +++ + +++++''"0 



^REPEAT 



.23 INSTRS IN .043 SEC. 



I WAS AT LiriR 10 IN REPEAT 



004 :EDIT 1 

001 !CASK A 
004 iSLIDE 2:7 

002 :ASK B 

003 :NEGATE B 

004 :JUMP B . + 2 

005 :HALT 

006 :INCREMLNT B 

007 !NAME 4 REPEAT 
SV;iTCHING REPEAT'S REFERENCES 



^EDIT REPEAT 
©EDIT TITLE 

©TITLE TO REPEAT :LETTER: :TIMES: 
@5 TEST LESSP :TIMES; 1 
@7 IFTRUE DONE 
©EDIT LINE 20 

20 REPEAT :LETTER: Djl'FERENCE 1 
QENP 

REPEAT DEFINED 



007 !RUN 

EXE 'UTING 1 TO 500 
+ 10 

++++++++++ 

HALT.. .45 INSTRS IN .117 SEC. 

007 !LIST 

YOUR PROGRAM: 

001 :CAS A 

002 :ASK B 

003 :NEG B 

004 :JUM B . + 2 (REPEAT) 

005 :HAL 

006 :INC B 

007 :CWR A 

008 :PUT P REPEAT 



^REPEAT 10 
+++ ++++-h++4-EDIT REPEAT 

@6 IFTRUE SKIP 
0END 

REPEAT DEFINED 

^REPEAT 10 

++++ +++-f + + 
^LIST REPEAT 

TO REPEAT :LETTER: :TIMES: 

5 TEST LESSP :TIMES: 1 

6 IFTRUE SKIP 

7 IFTRUE DONE 
10 TYPE :LETTER: 

20 REPEAT :LETTER: DIFFERENCE :TIMES: 1 



(Those sample di:ilogues produce alternative programs for the repeated 
printing of a koyhoard character supplied by the typist. Prompts from 
Simper are the current memory, address (a decimal numeral) and a ":" or an 
"!", depending on wlietlipr the addre.ssed location is empty or used. Lo^^o 
prompts 'V" at the outer level and "6" at the editing level. "^G" indicates 
a control character typed to stop a potentially endless execution sequence.) 



Fig. 1, Simper and Logo Sample Dialogues 
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Simper, is designed for interactive use. It is an assembly-language 
interpreter for a simple decimal machine with an addressable program counter. 
Its instruction set typifies those of early minicomputers and is similar to, but 
simpler than, that of the language Mix (Knuth, 1970). As a programming 
laboratory, Simper has three functional components: (1) a simulator for the 
underlying machine (Figure 2), (2) a real-time assembler which translates 
symbols and mnemonic ivistructions (listed in Table II) into machine language, 
and (3) an interpreter \;hich har.dlcs editing and general management of 
programs (Table III). This system allows students to generate and easily 
"debug" nontrivial machine-language programs. One can imagine that, when the 
Simper interpreter is rot running a user's program, it is simply waiting for a 
message from the user which is either a phrase in one of the three languages: 
machine, assembly or iriterprrter, or is unintelligible. The reader should 
examine Figure 1 a^r\ii», and then try to follow the execution of the san^ple 
program (which realizes the function: 2x + 9) in Figure 3. 

Logo (Feurzeig, et al., 1969) is a [ ocedural language whose basic data 
structures are strings of letters or words. The Logo instruction-set is easily 
expanded via procedure (operation) definitions, possibly recursive. An important 
feature of Logo (as opposed to Fortran-like languages) is that operations which 
a user defines are syntactically equivalent to Logo primitives. Logo contains 
essentials of the currently popular Basic language as a subset, but is superior to 
Basic in terms of mathematical consistency, and clarity of phrasing and control. 
Furthermore, Logo begins to addretis the important question of language 
extensibility, which is a fundamental measure of the usefulness people can 
attribute to any language for computing or thinking. 

The Logo interpreter used in these experiments was obtained from Bolt, 
Beranek & Newman Inc. (BBN) of Boston. It is written in Macro assembly- 
language for the PI)P~10. For the purposes of the experiments, Logo was 
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Registers (10 max.) Memory Cells (511 max.) 



(program 
counter) 



P 
A 
B 
C* 



001: 
002: 

500*, 250: 



Instruction Format (using righthand seven digits) 

000 

o r a 
p e d 
e g d — (indirect flag & address) 
r i r 
a s e 
t s 
i e s 
o r 
n 



(* indicates the configu ntion after the first experiment. The machine 
simulated within the Siinpor interpreter operates on ten-digit decimal 
numerals (words); some of which it "understands" as legal instructions. 
Each oporation mnemonic (Table II) corresponds to a two-digit code, ea h 
register has a one-(!'j:(it code. The address field typically contains a three- 
digit memory-coll desif^nator, or register and indirect address digits. The 
value in register P is always used as the memory address of the next 
instruction to be executed.) 



P'ig. 2. Structure of Simper's Simulated Machine 
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Table II 
Simper Machine Operations 
(* indicates operations added after the first experiment.) 



Mnemonic 

PUT 

LOAD 

STORE 

ADD 

SUBTRACT 
MULTIPLY 
DIVIDE 
DIVIDE* 

LAND 

LOR 

LEXOR* 

JUMP 
JASK 
COMPARE 



SHIFT' 

RO'i'ATE 

EXCHANGE 

INCRLMENT 

NEGATE 

ERROR* 

ASK 

WRITE 

CASK 

CWRITE 

lOT* 

RANDOM 

TIME 

WAIT 

HALT 

NOP 



Action (if not obvious) 

value of address field to register 

copy value in addressed cell into register 

inverse of 'LOAD* 

add value in addressed cell to register 



skip next instruction unless dividing by zero 
set 'ERROR' flag on division by zero 

decimal digit-wise minimum between register and memory 

decimal digit-wise maximum 

"exclusive or": 'LOR' except for equal digits 

transfer to address if register is non-zero 
transfer to address if a key has been typed 
three-way skip on memory cell's value greater than, 
equal to, or less than register's value 



flip contents of two registers 



overflow error code to register 

decimal numeral from keyboard to register 
inverse o'' 'ASK' 

AwSCII character from keyboard to register 
inverse of 'CASK' 

input/output transfer (for graphics etc.) 

random 10-digit integer to register 

seconds since midnight to register 

defer execution for milliseconds in register 

stop execution 

no-operation 



o 
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Table III 

Simper Interpreter Commands 

(* indicates items added after the first experiment, ** indicates items added 
after the second experiment. Parenthesized phrases describe options 
obtained by terminating a command v/ith ihe "altmode" key.) 



Name 
DUMP 

LIST or DEBUG 

RUN 

GO 

CLEAR** 
FIX or EDIT* 

FLIP** 
SLIDE 

SCRATCH or 
ERASE** 

FORGET or NAME 

NAMES 

SAVE or GET 
FIELDS 

FORBID or ALLOW 

NEWS 

HELP 

control-G 

GOODBYE 
or control-Z 



Action 

display decimal content of memory and registers 
(symbols too) 

display memory content in asspmbly language 

(and machine language), 'DEBUG' shows "secret" tables 

execute part or all of a program (and display 
registers) 

continue execution (and display registers) 

set a particular register's content to zero 

change the content of one or more memory cells 
(and show prior content) 

interchange the contents of two cells 

relocate part or all of a program in memory 

erase all of a program 

erase all or part of a program* 

erase or attacli a symbol to a memory cell 
(and say how much room remains for symbols) 

list all symbols and their cell associations 
(and their values) 

copy memory to or from long-term storage 

allow abbreviated instructions 

selectively alter the machine's instruction sef^* 

obtain the latest system news 

obtain general information about Simper 

stop any activity 

log out 
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007 


:LIST 




001 


:ASK A 




002 


:MUL A 


10 


003 


:ADD A 


6 


004 


:WRI A 




005 


:PUT P 


1 


006 


:9 




007 






008 






009 






010 


:2 




007 


:RUN$ 




13:04:12 





(the user had created the following program) 



(the user runs the program, denotes altmo^e) 
(the time) 



EXECUTING 1 TO 500 



P: 


A: 


B: 


INSTR: 






1 


0 


0 


ASK 


A 




INPUT NUMBER:4 ("4" typed by user^i 


2 


4 


0 


MUL 


A 


10 




3 


8 


0 


ADD 


A 


6 




4 


17 


0 


WRI 


A 




NUMBER=17 


5 


17 


0 


PUT 


P 


1 




1 


17 


0 


ASK 


A 




INPUT NUMBER:0 


2 


0 


0 


MUL 


A 


10 




3 


0 


0 


ADD 


A 


6 




4 


9 


0 


WRI 


A 




NUMBER=9 


5 


9 


0 


PUT 


P 


1 




1 


9 


0 


ASK 


A 




INPUT NUMBER:-4 


2 


-4 


0 


MUL 


A 


10 




3 


-8 


0 


ADD 


A 


6 




4 


1 


0 


WRI 


A 




NUMBER=1 


5 


1 


0 


PUT 


P 


1 


INPUT NUMBER:^G (user aborts) 


1 


1 


0 


ASK 


A 




[NSTKS 


IM 1 


.100 SEC 










}0 4 




(user continues a 


bit 


with 


no display) 



2 

13 



...4 INSTRS IN .042 SEC 
007 :EDIT 10 

010 !3 (the usor changes the function to be: 3x + 9) 

007 :HUN 



Fig. 3. Displaying a Simper Program's Activity 
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modified to coniniuiiicate with varioiis devices, including an "XY" plotter and 
graphic display terminals (the total system will be referred to ar» IMSSS Logo). 
A partial list of IMSSS Logo's primitive operations appears in Table IV, 
program editing/saving commands appear in Tables V, VI and VII, and the 
execution of a sample procedure is shown in Figure 4. The reader should 
maintain in mind that Logo is fundamentally a prefix language— commands may 
be composed of several operation calls, in which each operation is followed by a 
list of any arguments (possibly produced by other operations) it may need in 
order to be executed. 

One of the few common aspects of the Simper and Logo languages is line- 
editing. Table VII shows the commands which allow users to correct typing and 
other errors before they terminate their command-lines (causing Logo or Simper 
to try to obey them). Particulary useful are the commands (contvol-E, -N and 
-S) which allow previously stored lines or words to be injected into the user's 
typing. One of the functions of good line-editing capabilities is to minimize 
the burdens on the poor typist. 

Finally, it should be noted that in learning to use Simper, the student must 
learn the three languages (machine, assembly and interpreter) that are realized 
by the system. This is not a trivial matter for naive programmers, as the 
experiments have indicated. 

Logo's interactive structure is more nearly unitary. Its basic piece of 
execiitable codo is a line composed of one or more commands, and its basic piece 
of program (procedure definition), is an ordered series, of lines. The Logo 
interpreter Iway.s execiiting (or capable of executing) a user's commands, 
which may i upon Logo primitives or the user's own procedures. Control 
rotiirns to the \isor only when his or her last command and any conimands it 
might have called have terminated nornially or been aborted. A few of Logo's 
primitiv(\s may not be exomited directly by a user's procediiro, but there is not 
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Table IV 

Some IMSSS Logo Primitives 

indicates items added after the first experiment, 
** indicates items added after the second experiment.) 



Name 


Action 


TO 


allows creation of a new operation (a procedure) 


OUTPUT 

or RETURN* 

or REPLY** 


allows operations to return values to the evaluatcr 


EDIT 


allows the user to change an operation's definition 


MAKE 


associates a name with a value 


VALUE* or THING 


accesses tlie value associated with a name 


FRONT 


moves the "turtle" or train forward 


WHERE 


returns the present location of the train 


PLOT 


sends turtle drawing to XY plotter or robot 


SAY 


causes tlie audio system to speak a message 


PRINT 


causes the user's terminal to tyne a message 


REQUEST 


asks the user for a message 


SNAP 


makes a "snapshot" of graphics picture being drawn 


MOVESNAP* 


moves a snapshot as part of an animated display 


WORD 


rnmViinp*; two words (of Ipttprs or numerals) into one 


SENTENCE 


combines two words or sentences into a sentence 


FIRST 


returns the first letter or word in a value 


RANDOM 


picks a digit between 0 and 9 


SUM or ADD** 


returns the sum of two numbers 


IS or SAMEP* 


are two words ot- sontonnes identical? 


l'',Ql'ALP 


arc two niunbers equal? 


IK THEN ELSE 


decision naking 
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Table V 

Logo's Procedure Editing and Debugging Commands 



Name 

TO 

EDIT 
TITLE 
EDIT TITLE 
LIST TITLE 
EDIT LINE 
ERASE LINE 
LIST LINE 
END 

LIST 

ERASE 

ERASE ALL 
PROCEDURES 

LIST ALL 
PROCEDURES 

LIST CONTENTS 

LIST ALL 
ABBREVIATIONS 

TRACE 

BREAK 

EXIT 

GO 



Action 

begin defining a new procedure- 

begin modifying an existing procedure 

redefine the name of the procedure and its inputs 

change part ^f the title 

display the title 

change part of any line in the procedure 
delete any line 
display any line 

stop editing the procedure's definition 
display any procedures definition 
delete any procedure's definition or trace 
delete all definitions 

display all definitions . 

display the titles of all defined procedures 
display the user's abbreviations for all operations 

display a procedure's arguments/returned value 
whenever it is executed 

halt execution (same as control-G) 

halt and print a message 

continue execution 



(liulentnd coniniands may only be given after editing has been begun with 
'TO' or 'EDIT'.) 




Name 



Table VI 

Logo's File-manipulation Commands 
Action 



SAVE 



replace an entry on a file with the current 
contents of memory 



GET 

LIST FILE 
LIST ENTRY 
LIST PROCEDURES 
LIST CONTENTS 



append the content of an entry to memory 
display the entry names in a file 
display everything in an entry 
display only the procedures in an entry 
display the titles of an entry's procedures 
LIST ABBREVIATIONS display the abbreviations in an entry 
ERASE ENTRY delete an entry from a file 

COPY copy a text file to or from a file entry 
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Table VII 

Simper/Logo Line-editing Commands (* means Logo only.) 
Name Action 

control-A or erases the previous charactei* typed 
rubout 

control-W erases the previous word typed 

control-X erases tlie whole line (also control-U in Simper) 

control~R retypes the present line minus deletions 

linefeed continue:> \ line beyond 72 characters 

return or terminates a line (altmode is also known as "escape" or 

altniode "enter") 

controI-N* insert (into the present line) the next word from the 
previous (or edited) line 

controI-S* skip the next word from the previous (or edited) line 

controI-E* insert everything remaining in the previous (or edited) 
line into the present line 



(An example of Logo procedure editing: 

^TO WELCOME 

@10 SAY "HELLO THERE" 

@EDIT LINE 10 (causes the line number "10" to be printed and 

inserted into Logo's input buffer just as if 
the user had typed it, so it may be erased. 
Logo has now also grabbed the existing text of 
line 10 and knows 'SAY' to be its first word) 

@10 [ 01]20 ^Nsay "^S^Nthere" [ "] GOES A WELCOME" 

(The above editing line produced line 20 by 
using line 10. "^" means "control-", Logo's 
typing is in lower case, deleted characters are 
in brackets) 

©LIST 

TO WELCOME 
10 SAY "HELLO" 

20 SAY "THERE GOES. A WELCOME" (the new line) 
0) 
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♦-LIST ACKKRMAN (the user had defined the following procedure) 
TO ACKERMAN :X: :Y: 

10 IF EMPTYP :X: THEN RETURN WORD :X: "Y" 

20 IF EMPTYP :Y: THEN RETURN ACKERMAN BUTFIRST :X: "Y" 

30 RETURN ACKERMAN BUTFIRST ;X: ACKERMAN :X: BUTFIRST :Y: 

END 

which realizes a string example of Ackerman's function) 

TRACE ACKERMAN (TRACE* will allow the user to follow ACKERMAN's 
execution history, observing its arguments when it is 
called and the salues it returns when it is done. 
Recursively generated copies of 'ACKERMAN' are 
denoted by indentation) 



-PRINT ACKERMAN "XX" "Y" (execution begins) 

ACKERMAN OF "XX" AND "Y" 
ACKERMAN OF "XX" AND 
ACKERMAN OF "X" AND "Y" 

ACKERMAN OF "X" AND ("" is the empty string) 

ACKERMAN OF AND "Y" 
ACKERMAN RETURNS "YY" 
ACKERMAN RETURNS "YY" 
ACKERMAN OF AND "YY" 
ACKERMAN RETURNS "YYY" 
ACKE^{MAN RETURNS "YYY" 
ACKERMAN RETURNS "YYY" 
ACKERMAN OF ''X" AND "YYY" 
ACKERMAN OF "X" AND "YY" 
ACKERMAN OF "X" AND "Y" 
ACKERMAN OF "X" AND 
ACKERMAN OF "" AND "Y" 
ACKERMAN RETURNS "YY" 
ACKERMAN RETURNS "YY" 
ACKERMAN OF "" AND "YY" 
ACKERMAN RETURNS ''YYY" 
ACKERMAN RETURNS "YYY" 
ACKERMAN OF "" AND "YYY" 
ACKERMAN RETURNS "YYYY" 
ACKERMAN RETURNS "YYYY" 
ACKIORMAN OF "" AND "YYYY" 
ACKERMAN RETURNS "YYYYY" 
ACKERMAN RETURNS "YYYYY" 
ACKKRMAN RETURNS "YYYYY" (to PRINT) 

YYYYY 



Fig. 1. Tracing a Logo Procedure's Activity 
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a strict distinction between sets of coniinancls as exists in Simper's three-level 
structure. However, a quirk in Logo's evaluation scheme imposes a different 
syntax on editing and rnana[;ement commands versus other operations. This will 
be discussed later. Readers interested in more detailed discussions of Simper 
and Logo should refer to report-1. 

Periplieral Devices 

Various terminals and controllable devices were available to Logo and 
Simper students during and after both experiments (Figure 5). The machine- 
language Logo interpreter was modified to dispatch graphics (or other special- 
device) commands to a Sail program: Sailogo (Figure 5). This program and 
Logo acted as coroutines. Hence, Logo's control of special devices was realized 
by Sail procedures. 

Most special devices played a relatively small role in the work reported on 
here. A brief summary of only the graphics and animation facilities will be 
included. All the devices are fully documented in report-1.^ 

Both experiments sought to establisli good examples of how each device 
could be employed in solutions to programming problems. Some aspects of this 
will be discussed later with emphasis on relating device capabilities to teaching 
the concepts (e.g., those in Table I). 

All the students whose work will be discussed here bngan their 
programming at conventional, model 33 Teletypes(^). This slow (10-characters- 
per-S(^cond), noisy, inexpensive but reliable terminal was their basic means for 
coinnuniicating with Logo and Simper until they had mastered the languages 
well iMioiigh to make good use (jf such spp iul capabilities as graphics. In spite 



I nm mdeblHiJ to Steve Weyt?r for his fine i mp ! mhoh ta 1 1 on of the many special IMSSS- 
Lo(jo feaiums. r>iicl) as (jraphii:s aiuJ nnimatior, 
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PDP-10 Oporatiiig System 
I 
I 
I 

IMSSS Student System 
/ \ 
/ \ 
/ \ 

Logo Simper 

/ \ \ . I . 

/ \ \ . I . 

/ \ \ . I . 

TEC(R) Sailogo . 1 .-- 

. . I \ . \ I . \ 

I \ . \ I . \ 

I \ . \ I . \ 

Turtle Audio Train Plotter Teletype(R) IMLAC(R) 



(Dotted lines mark connections made after the first experiment) 



Fig. 5. Prograniiniiig System Structure 
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of obvious drawbacks, Teletypes were in plentiful supply and provided paper 
printout for projects (like posters) whose results students wanted to take home. 
Some students retained a particular liking for Teletypes, because tlie mechanical 
bedlam generated by one in operation fascinated them. 

Some fast (a few hundred characters-per-second), text-oriented, video 
displays were used occasionally by some students. These had limited, graphics- 
like capabilities, but they were not exploited in the experiments. 

In the first experiment, two groups of students used IMLAC(I^) PDS-1 
graphics displays exclusively. These groups, however, are discussed only in 
report- 1. For the students whose work is of interest here, the IMLAC displays 
constituted a goal, attained when a student's proficiency in the languages was 
adequate to allow comfortable use of the graphics system (Tables VIII and IX). 

The graphics, line-drawing system emulates many abilities of the robot 
"turtle" developed at MIT and BBN (Feurzeig and Lukas, 1972b). It allows 
movement on the screen to be specified by "x,y" end-points in addition to the 
turtle's normal, roving-polar-coordinates scheme (in which movement is specified 
by 'FRONT' and 'BACK' along an angular heading changed by 'RIGHT' and 
'LEFT'). For example, a square can be drawn by the Logo procedure 'SQUARE': 



TO CORNER :SIZE: 
10 FRONT :SI7.E: 
20 RIGHT 90 
END 



TO SQUARE :SIZE; 
10 CORNER :SIZE 
20 CORNER :SIZE; 
30 CORNER :SIZE; 
'10 CORNER :SIZE: 
END 



r 
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Name 
CLEAR 
WIPE 

SEE (HIDE) 
PENDOWN (PENUP) 
PENP 

POKE (UNPOKE) 
HOME 

FRONT (BACK) 
LEFT (RIGHT) 
SETHEADING 
ASETX (ASETY) 

ASETXY 

RSETX (RSETY) 
RSETXY 
THERE 
HERE 
ARC 

ZAP (l:p) 

PLOT (UNPLOT) 
SETSCALE 
SETTURTLE 
WRAP 
COMPRESS 



Table VIII 
IMSSS Logo Turtle-Graphics Commands 

Action 

erase the text area of the screen 
erase any drawing and put turtle home 
make the turtle appear (disappear) 
enable turtle to draw visible (invisible) lines 
return '"TRUE"* if turtle's pen is down, '"FALSE"' otherwise 
stick out (pull in) turtle's head 

move turtle to home position defined by 'SETTURTLE* 

move turtle forward (backward) a specific distance 

rotate turtle left (right) specific number of degrees 

point turtle on a specific angular heading 

move turtle horizontally (vert:cally) to an absolute 
screen position 

move turtle horizontally and vertically to a position 
move turtle horizont:illy (vertically) a relative amount 
move turtle relative to its present screen position 
equivalent to an *ASETXY* and a 'SETHEADING* 
return turtle's current position and angular heading 
make turtle draw an arc of specified radius and sense 
erase last turtle move(s) up to a visible line segment 
(do not) direct turtle commands to robot or plotter 
set screen resolution in units-per-inch 
set both scale and home position on screen 
set up screen boundaries for wraparound 

shorten IMLAC display list (precludes use of 'ZAP* or 'ZIP') 
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Table IX 
IMSSS Logo Animation Commands 

Name Action 

SNAP wipe screen and begin creating a numbered "snapshot" of 

whatever drawing (less erasures) is subsequently done 

ENDSNAP finish defining current snapshot and wipe screen 

ERASESNAP delete specified snap and its number 

WHATSNAPS return a sentence of currently used snapshot numbers 

SHOWSNAP display specified snapshot at turtle's screen position 

PUTSNAP identify a snapshot with an old or new "object" at a 

specific screen position, or move or erase an object 

MOVESNAP move an object (with wraparound) a relative distance on 

a relative heading and return object's final, absolute 
position ("R" in an object number has effect of 'RSETXY') 

WIPESNAPS wipe screen and erase all snapshots and objects 



(A procedure for moving an object, referenced by a snapshot number, across the screen 
might be: 



TO WALK :SNAPNUMBER: 

10 SHOWSNAP :SNAPNUMBER: 

20 ZAP (a snapshot is a "line" under erasure) 

30 FRONT 10 

'\0 WALK :SNAPNUMBER: 

END 

or, better: 

TO WALK :06JECTNUMBER: 

10 MOVESNAP :OBJECTNUMnER: "10 0" 

20 WALK :OBJECTNUMBER: 

END 

for the hitter, 'PUTSNAP' must first be uzed to tie a snapshot (an appearance) to an object 
at some screen position.) 
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Lines (l^:l^vIl may be erased by 'ZAP* and *ZIP* commands, permitting limited 
picture editing as well as primitive animation. One student produced a short 
.sequence showing a fuse "burning" down (disappearing into) and exploding a 
firecracker. 

'PLOT' allows one to direct the effects of most graphics commands to either 
an HP7202A plotter or a robot turtle (General Turtle Inc., CaUibridge, Mass.). 
Most students highly valued the ability to reproduce on paper what their 
programs had drawn on the display screens. Since students could use any type 
of terminal and still have their drawings appear on the plotter, this was 
exploited to encourage students to write and debug storable procedures rather 
than to just draw by direct commands. The plotter was only sporadically 
available during the first experiment and a true, robot turtle was available on 
occasion during both experiments. The robot came along with a "music-box" 
which was used significantly by two students in the second experiment. 

During the first experiment, it became apparent that more powerful 
animrAtion abilities would be possible and might serve as btrong motivation for 
more complex student projects. Prior to the second experiment, genuine 
animation was added to Logo and Simper was modified to access the graphics 
system as well (Appendix 3, pages 1ST and ILT). The 'SNAP' command allowed 
a student to save the eff<^cts of most subsequent graphics commands as a display 
subroutine within the IMLAC. These "snapshots" could then be shown 
anywhere on the IMLAC screen with 'SHOWSNAP' or 'PUTSNAP'. Snapshots of 
the same object in different orientations or sizes could then be shown 
successively in a "movie" (e.g., with 'MOVESNAP'). 

Although true animation ('PUTSNAP' and 'MOVE'SNAP* in Table IX) was 
not used by students in the first experiment, it was used in the second. Some 
student.s from the first experiment continued to work with Logo, influencing 
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some aspects of the developing animation system. A short film about 
Logo/IMLAC graphics and animation is available from IMSSS.^ Figure 6 is 
adapted from that film. 

Students used animation to produce such things as a flyable helicopter, a 
rocket launch, animated tic-tac-toe, movies of throbbing polygons, and a tennis- 
game. An example program appears in Appendix 4. 

The computer could also be made to utter sounds (via the Logo primitive 
'SAY') composed of any of several thousand prerecorded phrases, words, and 
phonemes stored in the IMSSS system. No organized use was made of this in 
the experiments, since it amounts to little more than the aural equivalent of 
TRINT*. Only a few terminals with audio output were available to students. 
Nevertheless, most students discovered the facility and some made imagin'^^ive 
use of it. 




Fig. 6. Successive Frames from a Logo-Animation "Movie". 



Pat Crawley of the Stanford Communications Department produced this film, starring 
Aflam Grosser. Greg Minchliffe. Steve Spurlock. Steve Weyer and the author. 
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3 Students, Tutoring and Curricula 

The desire to draw some conclusions about programming languages led to 
the student groupings shown in Table X. The first experiment had been 
concorned with assessing the value of graphics as well, accounting for the 
formation of groups IV and V. Those two groups are discussed only in report- 1. 
Groups I, II and III in both the first and the second experiments provided most 
of the data for comparing the languages, evaluating the curricula and 
characterising tutor-student-machine interactions. 

The first experiment influenced muny aspects of the second, some of which 
will be discussed here. For example, the enthusiasm generated by the graphics 
and animation system inspired the inclusion of graphics in late parts of both 
the Simper and Logo curricula, at a time wlien students liad mastered either 
language "well enough". 

Schools near Stanford were contacted in order to obtain inexperienced 
programmers, 10 to 15 years old— an age which is thought to ensure that 
children can master abstractions (Piaget, 1970), 

Teachers and others recommending students were asked not to base their 
selections on students' performances in school, because the intent was to study 
how any child learns to program. It had been observed previously that teachers 
tend to recommend only their better, mathematics students for such special 
projects. Apart from an admonition against such preference, the manner in 
which the invitation "to learn how to use a computer" was presented to students 
could not be controlled, so it cannot be stated that the enroUees constituted a 
cross-section of local students. 



1 
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Table X 
Experimental Groups 



Group Composition 

1973: I a students learning Logo and then Simper 

II 8 students learning Simper and then Logo 

III 8 students learning Logo and Simper at once 

IV 5 students learning Logo with graphics 

V 10 paired students learning Logo with graphics 

1974: I 5 students learning Logo and then Simper 

II 5 students learning Simper and then Logo 

III 5 students learning Logo and Simper at once 
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In the second exporinioiit, an atidi tional source of "gifted" students was 
available. They worked at teh^typewriters at homo, were assi^MUjd to groups 
matching I, II and III» received the corresponding curricula on demand by mail 
and could call myself or others at Stanford for help during certain hours. 
Unfortunately, only a few of these students did significant amounts of work 
with Logo and Simper. Their work will be discussed at appropriate times, but 
these students are not indicated in the Tables and Figures. 

More students responded than were needed for the groups outlined in Table 
X. As many as possible wore accommodated, including: friends wlio appeared 
later during the body of the experiments. Figure 7 presents some responses of 
the enrolling students to a brief questu/iinaire. Since students typically heard 
about the course from their mathematics teachers, the indicated preferences 
weren't surprising. As an aside, the students* attitudes toward school seemed to 
agree with observations in Jackson (1968) that one-fifth or more of all school- 
children will readily admit that they dislike school in general. 

In all, about fifty students involved thoinselves in the first experiment, and 
correspondingly, about twenty enrolled in the second. To some degree, this 
insulated the experiments from the problem of dropouts. Transportation 
problems created a few defacto dropouts, particularly in the first experiment. 

In the first exrorinier t, students were scheduled to use the machine one 
hour per day, four days per week, with more regard for their convenience than 
for experimental groupinf^ (Table X). Because the first experiment was in part 
a pilot study for the second, Friday?? were reserved for modifying the curricula 
and debugging the interpreters or devices. However, on demand of some of the 
more interested students, Friday was considered open too. 



40 



Page 33 



Age/School Distribution 



Age/Liking of School 



10- 



5- 



0- 











St 






















lo 


















pe 




wo 








14 


15 


15 






hv 


la 


gu 








14 


14 


15 






hv 


me 


gu 








14 


14 


14 






hv 


hv 


ma 








14 


13 


13 






hv 


hv 


ma 






14 


13 


13 


12 






hv 


hv 


ma 


gu 




12 


13 


12 


12 


fr 


hv 


hv 


hv 


ma 


gu 


13 


11 


13 


12 


12 


hv 


hv 


f: ' 


hv 


ma 


gu 


11 


10 


10 


12 


12 


10 


11 


\z 


13 


14 


15 


1 


2 


3 


4 


5 



age 



d i si ike 



like 



Age/Subject Preferences 



Engl i sh 



Languages 



Mathematics 



Sc i ence 



15- 



10- 







15 






14 














15 


15 


14 




14 






14 














15 


14 


14 




14 






14 






15 








14 


14 


14 




14 






14 




15 


13 








13 


14 


13 




13 






14 




14 


12 








13 


13 


12 


15 


13 


14 




13 


15 


14 


12 






14 


13 


12 


12 




12 


13 




13 


14 


14 


12 






14 


12 


12 


12 


14 


12 


13 


15 


12 


13 


13 


12 


14 


14 


13 


12 


12 


11 


H 


12 


12 


13 


12 


13 


12 


12 


13 


14 


13 


12 


11 


1 1 


13 


10 


10 


12 


10 


13 


11 


1 1 


10 


12 


12 


11 


10 


1 


2 


3. 


4 


5 


1 


2 


3 


4 5 


1 


2 


3 


4 


5 



12 
12 



14 



15 
15 
14 
14 
14 
14 



14 
11 



12 13 
10 13 



15 
14 
14 
14 
13. 
13 
13 
13 
13 
12 
12 
12 
12 
12 
11 
10 



(1 i s 1 i ke 



1 ike 



Fig. 7a. Some Information Cliaracterizing the 1973 Students 
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In the second experiment, students used the machine three hours per week, 
on two-or three-day schedules. This was done because the first experiment had 
indicated that students should be segregated by group to allow more uniform 
tutoring and to minimize the inevitable distractions raised in a roomfull of 
students working at different places in different curricula or on projects in 
different languages. The students still retained the right to go to another 
room, after their scheduled session had ended, and use another terminal. 

In order to obtain an initial assessment of each student's aptitude for 
programming, and to point out possible problems that each student might later 
have in learning the concepts, a test was constructed prior tc the first 
experiment. It consisted of qu'\stions gleaned from a wide range of sources, 
because no one test in current use seemed to be valid for the range of concepts 
in Table I. A number of commercial programming tests were examined and 

Q 

some questions from these were used. 

However, all these tests relied heavily on timed sections of multiple-choice, 
often repetitious questions. Such structuring produces easily graded results and 
is commonly used to boost the "reliability" (correlation among test applications) 
of a test. In contrast, development of the test used for this work placed 
emphasis on the more elusive but crucial notion of validity, and on the 
exposure of thought processes (e.g., per Bloom & Broder, 1950). 

A test, no mattor how reliable, is utterly useless if it fails to measure the 
property of interest. It may even be dangerously misleading. In terms of the 
theory of testing and evaluation, as currently applied in the social sciences (e.g., 
see Worthen & Saruiors, 1973; or, for the poUtics/reali ties of evaluation, see 
Jackson, 1968, and McLaughlin, 1974), validity like reliability is measured by 
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correlative techniques. However, no matter how long the chain of correlations, 
validity is ultimately founded in human judgements and evaluat* us uality. 
An example of validation taken from a commercial test-brochur is ouili: d in 
Appendix 2. It should alert the reader to some of the pitfalls tiiaf leaten 
those who wish to do aptitude testing, particularly with commercially available 
materials. Read critically, the example implies that testing theory and practice 
typically diverge when validity is demanded, yet validity of measures is 
precisely what must be demanded when meaningful research is the goal. 

A test \vas presented to enrolling students for two purposes. One, some 
measure of the students* aptitude for learning the concepts was needed for 
matched grouping. Two, hopefully it would be possible to match the way 
students attacked particular questions in the test with particular aspects of 
their performance in the experiments. The test might therefore shed light on 
the tutorial needs of each student. 

The preliminary test was constructed of some questions taken from the 
commercial tests mentioned earlier and questions of original design. All 
que.stions were formulated or reformulated to require constructive answers. The 
1973 and 1974 tests are reproduced in report-l and Appendix 2, respectively. 
Multiple-choice questions were thought useless. They force students to make 
judgements based on two levels: their relevant knowledge and the sensibility of 
the prescribed answers. The grader of such questions is freed of the burden of 
judging diver.so answers simply by having it thrown onto the test constructer 
and the least-experienced judges: the students. What students think about each 
question and why they give their answers arc important pieces of information 
that such testing destroys. For this work, students' answers were valued even if 
they were wrong or incomplete. Detailed answers would help evaluate the test 
as well as the students; and the judging would be done by persons experienced 
in the relevant fii^ld.s (i.e., by the author or other programmers). 
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The desire for constructive answers to all questions on the test is best 
justified by those examples of "wrong" answers which nonetheless showed that 
students were thinking along the right lines. Figure 8 presents some for a 
question derived from a commercial test (note also the subtle defects in 
drawings B and C, and the beguiling A-B sequence). It is important to note 
that answers like those in the figure evidence approaches to the questions which 
would have been counted completely right or wrong if nonconstructive answers 
(e.g., multiple-choice) had been required. Figure 9 shows examples of totally 
unexpected answers to a question of original formulation. 

One can neither assess a student fairly, nor know what a test is testing if 
the questioning scheme critically warps or limits information x'elevant to the 
purpose test. 

About one-hundred questions were selected for possib' 3 use in the test. 
Before the questions were presented to students enrolling in the first 
experiment, their difficulty, clarity, and the time required for their solution 
were evaluated by presenting the entire assemblage to several programmers 
(children and adults) in the IMSSS community.^ As a result of this simple 
evaluation, most of the questions were accepted and were presented in two tests. 
Students answered one-third of the questions on the day they enrolled, being 
allowed one hour. The second test was to be completed at home at each 
stiident*s convenience. The two parts of the test contained many similar 
questions. This was done because the preliminary evaluation had suggested that 
time should not be a factor in testing. Thorough and accurate evaluation of 
both test and students seemed to demand that as many questions as possible be 
answnrod. Two-part testing would also suggest whether or not any time limit 
should be applied to the single test which would be used in the second 
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The Question and the Desired Answer: 



Figure A was changed into Figure B by a simple rule. Please draw 
figure D so that it corresponds to figure C changed by the same rule. 



n. 






ABC 

What is the rule in words? BOTTOM SHRINKS, TOP GROWS 



Other Answers: 



■JRN IT UPSIDE DOWN AND ALTERNATE SIZE 



A IS A SQUARE WITH A CIRCLE, B IS JUST THE OPPOSITE 




YOU CHANGE TO THE OPPOSITES 



TAKE THE FIRST BASIC FIGURE AND CHANGE WITH THE 
SMALLER AND TURN UPSIDE DOWN 




THE SMALL TOP FIGURE BECOMES LARGE AND THE OTHER 
BECOMES SMALL AND THEY TRADE PLACES 



Fig. 8. Some "Wrong" Answers from the 1973 Preliminary Test 
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The Question and the Desired Answer: 



What one rule, not using arithmetic, was used to make the digits on 
the right from the strings of digits on the left? 



999999999 9 
556 6 
6106 6 

TAKE THE FIRST DIGIT 

Alternate, Unforeseen Answers: 

THE DIGIT USED THE MOST 
PREDOMINANT NUMBER 



WHAT EVER NUMBER THERE IS MOST ON THE LEFT. PUT IT 
ON THE RIGHT 



TAKE THE DIGIT WITH THE HIGHEST PLACE VALUE, 
OR THE ONE THAT REPEATS MOST OFTEN 



Note: "number" was acceptable altliough "digit" or "numeral" were 
technically correct. More than half of the students who gave 
complete answers to tliis problem seemed not to be aware of the 
distinction. Their rank and choices of words contrasted as: 



1973 or 1974 "digit" 

student rank or "number" 

"numeral" 

at or above median 14 11 
below median 3 13 



Fig. 9. Some Novel Answers from tlie Preliminary Tests 



47 



Page 40 

experiment. Unfortunately, many of the students failed to complete the lengthy 
"take-home" portion of the test, either for lack of interest or because they 
dropped out. For the second experiment, it was decided that the test would be 
shorter and that new students would work on it during their lirst day, taking 
it home to finish if necessary. 

Questions had been selected according to their apparent value in testing the 
ability to manipulate unfamiliar languages, model or analyze processes, form 
deductions, and visualize figural transformations (see Appendix 2). Some of the 
questions proved to be very useful for discriminating among the enrolling 
students. Two of these, the "candy-machine" and the "numbers-in-boxes" 
problems (Appendix 2, or report-l, page 169), required an understanding of 
concepts directly related to programming. Errors made by the students on these 
two questions were especially interesting and will be discussed. 

In the candy-machine problem, a partial flow-diagram was provided in 
which few state.s had been left blank and connections between some states were 
missing. The task was to complete the diagram in any reasonable way. Many 
students had trouble with the basic idea that a process can be represented on 
paper as a diagram of the sequence of events in the process. They left blank 
states empty, filled them inappropriately, or misconnected the dangling states. 
Errors in the solutions given could be divided into three classes: (1) 
assignment of unreasonable destinations for unconnected arrows, (2) assignment 
of unreasonable functions for undescribed states, and (3) treatment of the entire 
diagram as a maze in which only one path was to be marked as a likely 
protocol. Errors in class (1) or (2) suggest that a student had trouble using 
the information alr'^tidy present in the diagram to deduce reasonable "things to 
do next" or "things to do now". Class (3) is interesting because such errors 
indicate that a student viewed the diagram as a menu of instructions from 
which to choose one plausible sequence, rather than as a complete description of 
all possible soquonces, for some process. 
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The numbers-in-boxes question asked the students to obey a short, program- 
like sequence of arithmetic instructions which operated on some numbers 
written in a set of numbered boxes. Very few students correctly obeyed the 
instruction which read: "Add the number in box 7 to the number found in the 
box whose box number is in box 6, and write the sum in box 6". The sentence 
is hard to read, but the idea that a number (value) in a box could be used as 
the number (name) of a box (indirect addressing) was the typical difficulty. 
Many students also had trouble with the idea that writing a new number into a 
box should destroy its previous contents. Solutions fell into a few distinct 
classes which can be attributed to failures in the understanding of those two 
concepts. 

In both experiments, the test was used to establish a rank ordering of 
enrolling students, and performance on the test seemed to break into a few 
levels. For the first experiment, roughly equal numbers of students from each 
level were assigned to groups I, II and III. The second experiment's grouping 
was more constrained by the interaction of students' scheduling preferences with 
the desire to keep the groups in separate time-slots. In both experiments 
students determined their own class schedule within the time constraints 
mentioned earlier. 

Fignro 10 shows the composition of the groups according to testing rank, 
age and amount of time spent in actual work with the interpreters. The candy- 
machine and the "logic" (Appendix 2, or report-1, page 170) problems tended to 
be most influential in discriminating among students of equal age above and 
below the median. The youngest had the most trouble with the candy machine. 
Thoy missed the point that the diagram was an overall description of the 
machine. A few of the older students were familiar with flow-charts from 
school and thought that problem easy. In the first experiment, they had also 
been students who enrolled lato. These late arrivals usually did very well 
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Fig. 10a. Student Ranking on the 1973 Preliminary Test 
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Group Age Hours Spent Using Logo & Simper 

1$ 12 24.2 

111$ 9 47.8 

III* 13 27.1 

III 12 33.2 

II 13 15.4 

II 13 26.9 * marks students who enrolled 

II 13 25.9 late. 

I* 12 26.3 

median.. 11$ 13 33.7 # marks early dropouts. 

II 11 14.3 

1$ 14 45.4 . marks significant breaks in 

I# 13 3.2 performance on the test. 

III 14 12.0 

III 12 38.6 $ marks those who continued 

III* 12 16.2 programming well beyond the 

I# 12 1.5 experiment. 

I 12 8.0 



Fig. 10b. Student Ranking on the 1974 Preliminary Test 
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with the test, perhaps in part because they worked on it quietly alone— -a 
feature lacking in the massed testing of the first enrollees. This provided 
another reason for eliminating timing of the test in the second experiment. 

Examining the first experiment's test-results in terms of four constituents: 
the first three problems mentioned above, and everything else, the students' 
performances compare generally as follows. Students at the bottom of the 
ranking (Figure 10a) were unable to grasp the candy-machine and the box- 
program questions, they correctly analyzed only the clearest statements in the 
logic problem, and they failed to finish the test by a large amount. Students 
near the middle filled only the empty states in the candy machine reasonably; 
they correctly obeyed all commands but the indirect-addressing command in the 
box program, with some failures to erase a box's content when they wrote into 
it; they only missed the fourth statement in the logic problem; and they did 
fairly well on the rest of the test, though not always finishing it. Students 
near the top correctly filled all states and connected all the dangling arrows in 
the candy machine, a few of them missed the indirect-addressing command in 
the box program, they did the logic problem correctly, and they typically 
finished the rest of the test. Similar comments apply to test results for the 
second experiment, with the qualification that these students seemed to do 
better on the test than did those in the first experiment. 

Of course these breakdowns are not rigid. In particular, it is very hard to 
order many of uie tests in the broad middle regions of the rankings. Ranking 
forces transitivity upon performance ratings for solutions and problems which 
are often qualitatively different. But by demanding constructive answers, the 
answers contained much detailed information about the students and the test. 
If the test had been an exorcise in multiple-choice, it is not clear what 
information it would have conveyed, but it certainly would have conveyed less. 
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Some changes in the test were made as a result of the first experiment. 
Aside from making it shorter and unitary, and f»;;plying it individually with no 
time limit, changes typically involved readability and the elimination of 
frivolous questions. 

Tutoring. Both experiments were planned to depend upon written curricula 
which would control the basic information given to students. Interpreters for 
the programming languages would simply act as computational resources which 
the students could u.se to work problems in the curricula or experiment with on 
their own. However, any attempt to develop a fully self-contained curriculum 
for programming was deemed unrealistic. The main concern was gaining access 
to tutorial protocols generated by novice programmers working in the best 
possible environment for learning. Therefore, human tutors were provided who 
could help students over failures in the curricula and report their interactions. 
The tutors were to be knowledgeable in the programming languages being taught 
and would be familiar with the corresponding curricula. 

In the first experiment, it was hoped that enough tutors would be available 
each day to guarantee at least one for each five students in each group. Two 
instructions to the tutors were emphasized: (1) never type anything for the 
student on his or her own terminal, even when giving the most direct help, all 
typing must be the student's; and (2) when asked for help on any problem, 
encourage the student to formulate and try out his or her own ideas first, 
before making other suggestions. It was hoped that these in.structions would 
guarantee the purity of the protocol data and help the students to think as 
much about generating and debugging ideas as about getting correct results. 

Unfortunately, this tutoring effort failed in some crucial functions. First, 
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initial enthusiasm laded quickly and most tutors became sporadic in making 
their scheduled appearances. This seemed largely due to their lack of prior 
experience in v/orking closely with, and at the immediate demand of, several 
children at once. Second, and accordingly, the tutors could not maintain 
detailed logs of tlirir interactions. Third, the tutors did not always keep up 
with new developments in the curricula, partly because its production fell 
behind the students' pace and partly because pieces of it were designed "on the 
fly" to patch mistakes/omissions. In either case, new curriculum-text was made 
available to students and tutors simultaneously— a bad policy. 

Therefore, for the second experiment, tutoring was to be done by one 
person (the author) working with at most five students, all in the same group 
(per Table X), with the appropriate curriculum ready well in advance of each 
session. This facilitated note taking, gave the students personal, more uniform 
help, and ensured that problems with the curricula/interpreters were caught 
quickly. It is one reason why the number of students in the second experiment 
is smaller than it was in the first. 

Curricula. Development of "parallel" curricula for Simper and Logo proved 
to be the most deaninding task in setting up the experiments. Both the 
concepts and the Ip.nguagcs had to be taught, and this is done best with example 
problems, some of 'vhose solutions students must copy, modify or generate. The 
ability to teach b«.^th the concepts and the languages would be very sensitive to 
the choice of problems. For the students, the experiment was to serve to 
improve their literacy on the subject of computers and computation. Again the 
choice of cxampUs and projects would be important. 

Unfortunately documentation of problems used in similar work by others 
was scarce or cursory. Furthermore, most of the relevant research had been 
based on Logo or an equivalent high-level language. Problems appropriate for a 
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low-level language such as Simper are typically quite different. That was the 
fundamental obstacle to achieving apparent parallelism, given the intentionally 
diverse natures of the languages to be taught. So, the curricula were 
constructed to teach the concepts in roughly the same order, using whatever 
features each language possessed that could best be exploited for each concept. 

As well as the concepts, the mechanical details of each language had to be 
taught. A few features (line-editing, Table VII) of Simper and Logo are very 
similar and were taught at the same time in the same way. But most features 
were taught differently, either because they were appropriate to different 
concepts or because they were needed at different times as tools in the general 
structure of each language. The Logo and Simper curricula are documented, as 
they were during \hr. fi f experiment, in report-1. The discussion here will 
concentrate on the changes to the curricula which resulted from that 
experiment, in rep.uLiUon for the second (see also Appendix 3). 

Each curricului! v/as divided ir.to five logical parts, each typically 
discussing more tlian one noricept. Each part gave students programs to work on 
and fill-in-the-blanks questions to answer. The parts were distributed one at a 
time, giving the auLii a chance lu review each student's work on them. Those 
students learning Simper and Logo simultaneously (group III) alternately 
received parts for each language. 

The concepts were presented only very roughly in the order of Table I. 
For instance, the concept of a heuristic was introduced relatively early via a 
scheme for thinking about recursive algorithms. This involved a brief case 
analysis of some problems (derived from Pblya, 1D57): (a) what case can be 
computed? (b) how do I detect that case? (c) if not that case, then how do I 
generate one closer to it? (d) wliat must I remember for each case? and (e) 
when do I stop? In procedural terms, (a) and (b) form the procedure body, (c) 
is the recursive step, (d) preserves local context, and (e) is the stopping rule. 
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A special effort was made to produce visually pleasing curricula. Path 
pointers gave direction to the student, making the next question or inst ci\ n 
contingent upon the student's latest response. This subtly introduced decision 
making and sequencing (program control). It was, however, a bit too subtle for 
most students. Cartoons and examples were chosen for humorous as well as 
conceptual merit, and summaries were included so that the curricula could 
endure as reference material. 

Changes in the curricula between the two experiments centered on 
reordering and reformulation of discussions of several concepts. One effect was 
reduction of the sizes of both the curricula to roughly sixty pages (a reduction 
of 1/3 for Simper and 1/5 for Logo)* 

Modifications to the Simper curriculum were based upon apparent student 
confusions in the first experiment. In Part 2, an explicit reminder was added 
as to why computers don't understand human languages (because humans 
themselves have yet to comprehend their own faculties). This helped to clarify 
the curious results students obtained when they followed the advice to "type 
anytliing you please". Otherwise, Parts 1 and 2 remained unchanged (see 
report-1). Parts 3, 4 and 5 then proceeded along a mostly new course in 
covering material previously allocated a dozen parts. 

The new approach hinged on teaching machine-language first and thereby 
motivating both the desirability of the more convenient assembly-language and 
the need for the interpreter's powerful editing language. All this was 
permeated with allusions to message processing and computational context. The 
former being a rnotaphor used witli some success in tutoring experimeut-1 
stucl(Mits, and the latter being an essential concept that had been trouble.sorne to 
many of those students. 

Part 3 First sought to clnnr up the b'sscr probloin of what literals are in 
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the language by demonstrating more examples. It also tried to motivate the 
need for registers as a scratch pad. It then approached one aspect of context: 
attention. The machine was described as giving its "attention" to registers and 
memory cells when in the process of executing a program— only certain values in 
those cells could be "understood" as legal instructions. Without an ability to 
focus its attention on a source of messages, the machine would be quite useless. 
Registers, as defined by the machine's structure, were described as a means for 
passing messages between instructions, reflecting an aspect of the machine's 
internal context. In spite of the simplicity of the machine-language programs 
written in Part 3, editing commando such as 'SLIDE' (Table III) found direct 
application; and a few students suggested new ones (e.g., 'FLIP'). 

Simper Part 4 reviewed two of the three segments of machine-language 
instructions covered in Part 3 (i.e., the operation and register fields), and went 
on to motivate the need for the address field as a source of the second input to 
binary operations (e.g., addition) and as a means for accessing "full-word" 
chunks of data. Since the structure of most machines modelled by Simper was 
once dictated by both technology and economics, a brief word to that effect was 
included in the tutoring. The essential role of memory in any machine 
deserving of the name "computer" was alluded to. Using a time-telling program 
ilevoloped in this and the previous part, students were led into assembly 
language. The use of new editing comnuinds (e.g., 'LIST'), designed especially 
for this second language, were also introduced. The remainder of Part 4 dealt 
with execution sequencing, and decision making. It attempted to motivate these 
with an odd/even number-testing program analogous to one used in the Logo 
curriculum. This problem was formulated as a test of the student's ability to 
translate an English statement of a program into Simper. Students having 
trouble writing the program were helped, and details of this tutoring were 
recorded. The final version of the program demanded an understanding of 
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literals, names (in the form of machine addresses), binary operations, register 
and memory-cell intercommunication, conditional and unconditional branching, 
and the communication of symbols to and from the typist. To cap off this 
work and prove that problems can often be solved in several externally 
equivalent ways, tlie curriculum suggested rewriting the program witli fewer 
instructions (three basic forms existed). 

Simper Pari r> attempted to crystallize the idea that interactive programs 
define new languages and tlius set up new contexts when run. Student-defined 
symbols (names) and relative addressing were introduced as conveniences, 
peculiar not just to assembly-language programming. They found application in 
a random-number, guessing-game program used also in the Logo curriculum. 
The decision-making operation ('COMPARE') was then introduced as a way of 
making the students' programs smarter— they could now give their users hints 
like: "GUESS HIGHER". At this point, the concept of a function was 
introduced much as in the original curriculum and with the same visual aids. 
Part 5 closed with some reviews of messages and context in terms of the 
"domains" of functions. 

Now students could go on to learn how to use the Simper graphics 
capabilities (Section 2), which were identical in power to those of Logo. They 
could also begin to learn Logo if they had not already. As in the first 
experiment, most students did not complete both curricula, so things like 
"pushdown stacks" were discussed only in terms of special projects wliich a few 
.students undertook. 

Part 2 of tlie now Logo curriculum was changed in the same way as was 
SiniptM' Part 2, Part 3 kept the old discussions of literals and simple, direct 
commands, but then led into procedures as program elements, rather than 
naming (e,g., with 'MAKE'). Time- and date-telling procedures were the focus 
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because experiment- 1 students had generated these on their own and had found 
them useful as well as instructive. Tlie idea that problem solutions could be 
broken into logical parts was dennonstrated simply by a procedure that Ci.iled 
both the time and date procedures* 

Logo Part 4 discussed naming first in terms of procedure names and then 
in terms of input variables to procedures. 'MAKE' was only introduced when a 
student's special project absolutely demanded it. Execution control was 
illustrated in terms of a procedure that called itself unconditionally, running 
forever. This was parallel to what had been done in Simper. Editing 
commands were reviewed, and message passing and context were developed ir. 
terms of procedure inputs. RIock diagrams, which had little st:ccess in the first 
experiment, were simplified and given a second chance as aids. As for Sin?.per, 
the introduction of functions was ur.cl^anged. Logo's parsing of complicated 
command-lines was depicted with diagrams, and a fill-in-the-blanks script 
adapted from the original curriculum, 

Logo Pari 5 opened with decision-making as an essential ability of any true 
computer and a brief discussion cf the programmer's role in using such abilities 
for his 01 her purposes. The various Logo predicates were covered using block 
diagrams, examples and exercises taken from tho original cu?'riculum, The part 
predicates '^lay in deci5:ion-making ^vas emphasi'^.ed. Composition of cornmands 
was Ctiscussed, particularly along the lines of a tolcphone--:all metaphor. This 
"v'as e::pan(lud further in torms of good program articulation as '.he following 
program was developed. The use of simple rorur.sion (iteri.tior) and stopping 
T-ules was mctivated by a clock sinuilat:-:' vvhich printed "TICK" or "TOCK" 
(h -ending upon wheiluu' the time (in sovonf-s) maintained by the system was 
even or oiUl Applications of Logo's two decision-structures ('IF'... and 'TEST'..,) 
also were contrasted with this program as: 
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TO KLOK TO KLOK 

10 TEST EVKNP SECONDS 10 IF EVENP SECONDS THEN PRINT "TICK" 
20 IFTRUE PRINT "TICK" ELSE PRINT "TOCK" 

30 IFFALSE PRINT "TOCK'* 20 KLOK 
40 KLOK 



where 

TO SECONDS 

10 RETURN OUTLAST BUTFIRST DUTFIRST TIME 



and 

TO EVENP :X: 

10 RETURN ZEROP REMAINDER QUOTIENT :X: 2 



were also defined by the students. That Logo has, as most languages have, 
redundant operations, was demonstrated by having students write a procedure 
(•AIN'T) equivalent to 'NOT'. 



True recursion (making use of local contexts) was introduced, as in the 
earlier curriculum, using the "little brothers" analogy of Brown and Rubinstein. 
The true effect of returning control but not a value from a recursively called 
instance of a procedure was clarified. 



The concept a "bug" (nnforseen error) in a program was illustrated by a 
number-guessing-game program similar to that in the Simper curriculum. 
Students were asked to design the program and then modify it in several ways, 
all of which, except the last (using 'COMPARE'), suffered from particular 
inabilities to interact reasonably with the human guesser: 



TO QUIZ :PICK: :GUFSS: 

10 TEST COMPARE :PICK: :GUESS: 

20 IFTRUE PRINT ''SMARTY!** 

30 IFTRUE QUIZ RANDOM REQUEST 

^10 IFFALSE IF LKSSP :PICK: :GUESS: THEN PRINT "GUESS LOWER" 

ELSE PRINT "GUESS HIGHER" 

r>0 IFFALSE QUIZ :PICK: REQUEST 



TO COMPARE :X: :Y: 

10 IF BOTH NUMBKRP :X: NUMBERP :Y: THEN RETURN EQUALP :X: :Y: 

ELSE RETURN "FALSE" 
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Logo's file system was introduced at this point because it seemed natural 
that students would want to save this particular i)rogram. As had been done 
earlier for editing commands, a one-page manual was included for file 
manipulations and abbreviations. Some examples gave practice. 

Recursive procedures that return values were introduced^ using a more 
thorough treatment of an example from the original curriculum. Both block 
and little-brother diagrams were used to describe how a procedure that removes 
all instances of a selected letter from a selected word should work, .The 
students were asked to try their hands (and heads) at solving the problem by 
synthesizing the procedure. Errors and questions were to be noted and solutions 
were provided. A playlike script attempted to solidify understanding of one 
solution. Different forms of solutions (e.g., left- and right-recursive) were also 
discu.ssed. Then a modification was suggested which would lead to the solution 
of another problem: writing a procedure to reverse a word. Up to this time, 
no stopping rules liad been concerned with numerical criteria. Now, counting 
and program self-modification were introduced by a procedure that counted up 
(or down) to a limit and then modified itself permanently by self-erasure: 

TO SKLKDKSTRUCT :HOWSOON: 

10 IF LESS? :HOWSOON: 1 THKN ERASE SELFDESTRUCT 

ELSE SELFDESTRUCT DIFFERENCE :HOWSOON: 1 

The final of Part 5 developed Polya's ideas on solving problems in terms of 
the structure of general recursive procedures. Several projects derived from the 
first curriculum were present cL Students could then go on to Simper and 
graphics, as they pleased. 

The graphics curriculum was derived from that presented to students in 
groups IV and V (Table X) in the first experiment. Since students in tlie 
second experiment would have already mastered much of the basic languages, it 
was short<Mied (to 7 pag»\^) and concentrated on animation projects. Each 
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student who completed either or both hiiiguages was asked to think of a project 
to work on, graphics providing an enjoyable and quite acceptable knedium. 

What and how the students were taught were functions of two main beliefs: 
(a) testing should be an educational experience; and (b) people should 
understand as many of the valuable products of their culture as possible, 

Tlie nature of the tutoring prescribed implicit testing of each student, yet 
all students always got each "answer" eventually. Especially in the second 
experiment, students saw their actions precipitate prompt, accurate tutorial 
responses. For both the students and the research, a working goal was to have 
students come to feel at ease with dialectical responses to their questions. For 
a few students, this proved to be a difficult departure from their accustomed 
experiences in formal schooling. 

One knows not when a cultural product might be essential (physically or 
psychically) to the individual or to the whole culture. But value is subjective 
and evanescent, and one wlio finds an application for a cultural artifact may not 
also find others expressing agreement that the application is valuable. 
Nevertheless, any successful try at an application (discounting plain luck) first 
demands some understanding. This reeks of technology, yet art, history, 
engineering and gastronomies all draw from science to form their own 
technologies. In short, everyone should understand and be comfortable with his 
or her machines (e.g., Pirsig, 1974)—in tlie particular instance here, the 
"machine's machine": the computer. Some of the children in these experiments 
hopefully would benefit in just this way, even if they might not discover the 
fact for ye.irs. A nagging fear that this might be a vain hope was in.stilled in 
this author when conversing on this research with a successful educational 
researcher, who regularly uses computers for statistical analyses. Hearing that 
computers can do more than perform numerical computations left that 
professional surprise an rv ufiple of how a tool can be misunderstood. 
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4 Data Acquisition and Analysis 

The simple methods chosen for ohtciining data and the type of analysis 
believed to be appropriate for this essentially qualitative study will be discussed 
here. Some reasons why the analysis should not be founded naively upon 
classical statistical inference will also be outlined here. 

Throughout both experiments, the Simper and Logo interpreters saved 
information on each student's activities. Each command or response typed by a 
st'\lnnt was appended to his or her individual protocol file on the operating 
system's disc-storage. Prompts and error messages elicited from the interpreters, 
and output from students* programs were also saved as they happened. Each 
such piece of information was tagged with its time of occurrence. At the end 
of the first experiment, the Logo and Simper interpreters were modified to 
accept these files directly, in place of keyboard input. Each student's 
interactions witli tlie interpreters could thus be replayed and be observed in 
their proper context. In addition, the error-message and timing data in the 
protocol files could be analyzed in more conventional ways by forming summary 
statistics such as error frequencies and typing delays (response latencies). This 
sort of data was not of particular interest, except insofar as it could be used to 
point out particularly common errors, or confusions due to imperfections in the 
curricula or the tutoring. Some additional data were obtained from notes made 
by th(3 tutors during the first experiment and the author's notes from the 
second exp^'riment. The bulk of the daia derives from the latter notes and 
replays of recorded protocols. Some problems with the IMSSS time-sharing 
system, oncounteroti during the first experiment, are discussed in report-L 
Most of them also affected the second experiment in minor ways. 

The u.s{} fulness of tliese experiments rests upon the ability to understand 
students as they have tried to learn Logo, Simper and the concepts explained in 
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the currictila. Classical hypothesis-testing is not of concern in this wo 
although others liave attempted to reduce their analyses of children learning 
prograniuiin^^ to clinical forms, e.g.: 

''Children who have had a Lofio experience for several 
semesters wilt perform sipjdficantly better on problem solving 
tasks than children who have been in a non-Logo control 
environment." 

- Folk et alia, (1973). 

P'or this work, tlie goal lias been an e.xposure of basic features of how 
children think in the relatively unconstrained environment of a programming 
laboratory. That is a qualitative exercise in careful judgement, and it centers 
on a detailed study of errors made by students as they try out new ideas for 
theiuselve.s. Hut, as in any analysis of data, an analysis of errors must be valid 
in the sense tliat its meaning is not warped by analytical constraints, 

"It is a capital mistake to theorize before one has data. 
Insensibly one begins to twist facts to suit theories^ instead of 
theories to suit facts." 

—Sherlock Holmes, by Sir Arthur Conan Doyle. 

Whenever statistical procedures (such as classical hypothesis-testing) are 
applied to data, certain mathematical assumptions (e.g., of scale and 
di.stribution) about the data must legitimately be met, if resulting conclusions 
are to carry any scientific weight. In too many research settings, the 
importance of procedural assumptions is ignored, generating technically invalid 
or misleading analyses. 

Those remarks evaiig*di/.o to those who, perhaps as students or other well- 
intentioned resoarchf^rs, might be sediiced by the apparent power or elegatice of 
various, common, analytical procedures (e.g., analysis of variance), ••vhile being 
unaware of some of their potential for frivolous application to expediently 
massaged ('?.g., vac\io\»sly scaled, "t ran.^generatod" an-l/or "Wi nd.^ori/jjd") data. 
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In the social sciences, especially in education, the style of research too 
often reflects a Quixotic quest for numerical results, apparently stemming from 
the belief that quantitati veness is a precursor of objectivity and respectability 
in one's discipline. 

''They use statistics as a drunkard uses lampposts, for support 
rather than illumination/* 

--Andrew Lang. 

For instance, some psychologist's fundamentally quantitative data might 
mysteriously be provided a "scale" on which important "variables" could be 
"measured"— the accrueing benefit to psycholo^ xiuiking with that brought to 
music by some quitarist's chance strumming of the Lost Chord. 
Quanti tativeness at any cost is a precursor of sham not objectivity. This, and 
the dangers lurking in the fog of "cookbook" mastery of statistics, are amplified 
by the relatively easy access most researchers now have to computerized, 
statistical procedures (e.g., Ellis, 1972). Perhaps as seriously, widespread use . 
standardized p-'>cedures has led to stereotyped theorizliii^ (t^-g-i to hypothesis 
testing restricted to linear models and Gaussian-distrihuMon theory), wherein 
convenient rather than reasonable procedures defiiv th-^ hojry, and the implicit 
necessary assumptions of the procedures are virtually ignured. The judgemental 
analysis for this work hopefully respects the qualitative nature of the data to 
which *t is applied. 

An example taken from Simper protocol data illustrates the nature of the 
judgemental analysis used here. It shows how one student suddenly seemed to 
grasp a concept with which he had been having trouble--name-value association 
(a(l(ir(\ssi ng) in Simper. If the pro^a-ainining is unclear, the reader should refer 
hark to Chapter 2, The student's dialog with Simper is reproduced here as he 
was a gaffed in writing a program to realize the function: - 3 : 
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003 :2 

015 :ASK A 

016 rSTOHF;: A 200 

017 :MULTIPLY A A 

018 rSUBTHACT A 3 

019 :WRITE A 

020 :RUN 16; 



He appcnrs to understand tlie purpose of addressing in 'STORE A 200', but 
liis program contains several errors that suggest otlierwise. The first causes 
execution to stop at 017 because the symbol 'A\ used in the address field of the 
instruction in 017, has no binding and tlius no associated value. The student 
thought he could square the A register's content with the instruction: 
'MULTIPLY A A', and he thought he could subtract 3 from that with: 
'SUBTRACT A 3*. In both cases, the meaning of the register field seems to be 
understood, but the address field is misunderstood. The student corrects the 
first error (messages from the interpreter are in lower-case): 



020 :FIX 17 

017 iMULTlPLY 200 200 

200 isn't a rec;ister, use a, b, or p 

017 :MULTIPLY A 200 

020 :RUN 15: 



and the pror vorks except that, because location 3 contnins tlie value 2, the 
subtraction n i do what he expected. At this point he seems to understand 
that he can store and access values via addresses (names) because of his correct 
use of tlie register and address fields of the 'STORE' and 'SUBTRACT 
instructions. But the idea crystallizes: 



020 :FIX 201 
201 :3 



when he associates the desired value 3 with the name (location) 201, 



020 :riX 18 

018 :SUBTHACT A 201 
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and correctly acces.s(»s it to complete his program. From this dialog, one can see 
the student begin to apply the concept in correct fashion (in the 'STORE' 
instruction), then fail because he has not yet mastered it fully, iind finally 
succeed, partly helped by simple error diagnostics. The student later made a 
similar r^'-take, but corrected it at once, 

Fc r the purposes of these experiments, this type of analysis can suggest 
when i.ud how a student masters sometliing presented in the curricula. Students 
can be compared in far greater detail than can be done with occasional discrete 
tests, the curricula and languages may be evaluated very finely, and the 
preliminary aptitude test's validity may be rated subjectively. 

The langriage evaluation aspect of the protocol analysis is partly 
demonstrated by the following examples from Logo and Simper protocols of 
absurd or misleading responses to students' syntactic errors. First, consider: 

-PRINT :::SNOOPY::: 

don't use the empty thing for a name 

in which the student's obvious attempt at multiple i ndi rect-addressi ng is 
complet'dy misconstrued by Logo's simplistic parsing (the first pair of colons 
are found to contain no name string). And second: 

001 :SUBTRACT 1 FROM P 

002 :RUN 

warninj,'! you forgot to name a location fromp 
illegal memory reference 0 at 1 

in which Simper, striving to extract three fields and no more from iho student's 
\ Compressed a simple syntactic error and generated a more advanced type of 
error. Not only was this spurious error unrelated to what the student had 
done, it exposed the student to a situation for which he was not yet prepared 
(i.e., the usp of asspnihler symbols). These examples were taken from the first 
fXpt'iimtMit's data. Since it was in pait a pilot study for the second, the 
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analysii. Ird to changes in Lo^^o and SiinixM' that corroctod at least f.onio of tliese 
kinds 0^ faiiUs. 

It shouhl be clear th;it the Logo and Simper interpreters used are not 
".mart". They do not tntor their )isers on the semantics of programs— in the 
experiments, that was h?ft to hninans. The intor{)rrtors tlo little more than trap 
syntactic > rrors, soiuetimes acceptably well: 

001 :SHIE'T 

imspocified register, use ti, h, or p 
001 :SniFT 7G 

76 isn't a register, use a, b, or p 
001 iSFlIFT A 

i.}iift uses I, or r or 0 and n rniinber in tlie address field 
001 :SIIIFT 056 

056 isn't a register, use a, b, or p 
001 iSHirr L 56 
1 isn't a register, use a, b, or p 
001 iSHIFT A I>57 

As was mentioned earlier, a simple analysis of the protocol files was also 
carried out. Tor example, if a Simper student's errors were categorized and 
plotted as in the graph in Figure 11, an interesting effect nsually could be 
observed: familiarization with the language led to a decrease in errors classed 
as syntactic and an increavSe in those classed as semantic--an infererence being 
that as students increase their active programming vocabulary, tliey can more 
oasily realize tlieir ideas about problems as programs and find tliat tlieir ideas 
(now programs) aren't always debugged. But this is more reasonably 
corroborated by tutorial data and detailed protocol analysis. 

Th(? tutoring |)rocess oft<Mi was dialectical, especially wlien students became 
confused. It therefore possessed an analytical fac(}t which influenced tlie 
recorded data. For example, when students expressed doubt about tl. ir ability 
lo solvp a particular problem, they were askod to explain the solution they liad 
attempted, th'Mi they and the tutor examined the pros autl cons of this in 
r'dation In the pr<;hlern ,sf .it eni<wi I , e(UiVfM[;i n-^ toward a wt^rkin^,^ solution. For 



b j ] 1 163,dta:3 AUGUST 1. 1073 12:20PM 

1 DAYS. 1 LOGINS. 33.40 MINUItS ON. 372 KEYS TYPED ON 60 LINES. 
RESPONSE DELAY. MEAN & DEVIATION: 32.15 ^4. 36 SEC. 

I. 00 LOGINS/DAY. 33.40 MI NUT ES /DAY . 372.00 KEYS/DAY 
33.40 MINUTES/LOGIN. 372.00 KEYS/LOGIN. 60.00 LINES/LOGIN 

II. 14 KEYS/MINUTE, 6.20 KEYS/LINE. 1.80 LINES/MINUTE 
36 ERRORS: 30 GENERAL. 0 NAME. 0 RUN, 0 FIXUPS 

36 SYNTAX ERRORS. .60 SYNTAX ERRORS/LINE. 1.08 SYNTAX ERRORS/MINUTE 
,00 nun ERRORS/LINE. .00 RUN ERF 'MINUTE 

0 10 20 30 40 50 60 

1 , I . I . I . I . I • I . 

4|/y 
5|/C 
6|# 
1\U 
8|# 

l|UNSP[CinLO HLGISIER. USE A. B. OR P 
? lEMPlY^ATTTrnit-SS f I ELD? 

3lSH|.rr KDIA'U USE L. H OK (J 8f A NUMBER IN THE ADDRESS FIELD 

4 1 EXCHANGE USES A REGISTER IN THE ADDRESS FIELD 

b\mVH VAIULS fRUM 0 TO 99^1 MAY DE PUT 

()] ISN'T A REGISTER, USE A. U. OR P 

/jSHlFTS OR RDIAIES MUST HE HLIWLEN -QOO &• +999 

Kj UNKNOWN (tPLHAT ION 

0,2 

I ^ syntactic 

I 
I 

Eri'urs per | 
Cominantl Line 0.1 




I ^* seinan t i c 



Q y. ^ _ - t ^- - . 

0 12 3 4 

W»iekr> 1 n Course 



Fig. 11, A .Siinph^ Quantitative Analysis of Protocols. 



60 



Page 62 

reasons outlined earlier, this technique was employed extensively and uniformly 
only in the second ex[. riment. 

Implicit testing was thus an important part of the curricula and tutoring 
(e.g. pages d9L & 49S, Appendix 3), apart from the aptitude testing done before 
both experiments and after the second. It allows students and their mastery of 
the concepts to be compared at various stages. 

The second experiment's post-testing was done only with those students who 
completed all curricula and projects for both Logo and Simper, The posttest * 
contained questions like those used in the preliminary test, but also asked 
questions that required writing Logo and Simper programs (see Appendix 2). 

The preliminary aptitude test's results were presented as a rank-ordering of 
the students (Figure 10) obtained by a "forced-choice" evaluation of their work. 
Perhaps this is not justifiable, for a test whose validity remains uncertain. At 
least a few students, especially near the medians, might well be reordered or 
considered hopelessly tied. Yet rank-ordering enforces transitivity. The theory 
behind the test is simple and qualitative: take as questions examples of the 
thinking that programmers are typically asked to do, where some types of 
thinking are more important, in the programming sense, than others. The 
former relates to validity, the latter to transitivity. No part of the theory 
suggests cardination or interval scaling. Perhaps a careful, subjective evaluation 
of students' constructive answers can more nearly approximate an objective 
ranking-technique (if one exists) than falsely objective testing/scoring 
procedures can. The theory behind the test may be wrong or incomplete, but 
(lotfMnuning that is on»^ purprjso of the experiments: what do students' 
int^Miictions with the preliminary test have to do with their interactions with 
the programming cmricula? The test's validity teeters on the subjective choice 
of questions, and stands or falls subject to experimental data. 
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5 Results 

Anecdotal and judgemental information will be presented which helps in: 
(a) understanding the students, (b) evaluating the tests, programming languages 
and curricula, and (c) characterizing relevant features of the tutorial process. 

Apart from normally recorded data (replay files and tutorial notes), 
students provided both direct and indirect feedback in both experiments by 
explicit opinions and by their behavior. Figure 12a summarizes students* 
responses to a questionnaire they received shortly after the first experiment. 
The total numbers of opinions for all rows are not identical because some 
students felt insufficiently exposed to every item to render an opinion. After 
the second experiment, a somewhat more qualitative questionnaire was given, but 
only to a few students who had finished both curricula and some project. Their 
comments appear in Figure 12b. 

Most of the feelings expressed in Figure 12 correlate with casual comments 
made by the students during the experiments. In the first experiment for 
instance, the plotter was preferred to the robot because *'it draws better" (it 
produced more faithful drawings); the plotter was preferred to Logo graphics 
because it produced portable, permanent results; and Logo graphics was 
prf^ferrod to the robot because it was faster, more accurate, and personally 
available for each student. In the second experiment, more emphasis was placed 
on the languages and concei)ts, hut most students still expressed clear 
preferences for graphics and Logo over teletypewriters and Simper, despite the 
addition of full graphics capability to Simper. Graphics instruction in the 
se(!()nd experiment occurred only at the end of either curriculum and was related 
to a project chosen by each student reaching that point. Thus, ench student's 
likifig of graphics and animation was a function of his or her feelings about 
the pr()ject(s) chosen. For example, one student chose to implement a ?^n'aphic 
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Fig. I2a. The 1973-Students' Preferences 
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Likes: 

"I got to learn two langus.^rs and I v^as able to better 
understand the difference botv/een languages machines 
understand and i:inp^r,a^;es people undtrsland." 

"Lik?d everything about it and had a great time." 

"I liked being able to us'» letters as \v3ll as numbers in 
writing programs— I was able to write programs using 
words and sentences, not just numbers." 

"It gave me something to do.'* 

*'I liked the experience of getting to know them [Simper & 
Logo]." 

"Everything was A.O.K. including the teacher ... always 
willing to help." 

"The amount of time [plenty of it] to do things." 

"I like the fact that Logo is so easy to follow." 

"[The curricula were] well written, ... and I feel I learned 
alot. I also think the teacher did a good job." 

Dislikes: 

"I didn't really learn that much, you would just learn 
sometliing and then forget it. It either was so easy or I 
didn't understand it and got boring." 

"Simper ... [I can't follow] where it goes next as easily as 
in Logo." 

Suggestions for Improvement: 

"There should be a little bit of discussion for everybody 
before the beginning of each class." 

"Have a few review sheets and review 'quizzes'." 

"Drop Simper." 



Fig. 12b. Some 1971-StudtMits' Opinions 
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ping-poiig game complete with scoring (Appendix 4). In doing so he learned 
virtually all there was to know about the graphics system and thence rated 
using graphics first among his experiences. 

The item listed as "games" in Figure 12a refers to certain programs 
accessible to students on the IMSSS system, such as Hangman, wliich were 
intentionally not announced until the students completed most oT the curricula. 
Some students, of course, accidentally discovered a game or two. The policy was 
that games could be used after a student's regular session with Logo or Simper. 
Features of popular games are mentioned in report-1. Students were encouraged 
to write their own games and some were used as examples in the curricula, 
particularly in the second experiment (see Appendix 3). 

Since, as outlined earlier in Chapter 3, the tutors generally fell short of 
expectations in the first experiment, their highly favorable rating in Figure 12a 
could provide ammunition for those who believe that students are incapable of 
appraising their teachers on educationally relevant grounds. The remarks in 
Figure 12b, however, evidence some astute thinking; particularly the first and 
third, which are beyond oxpectations. The student who felt she hadn't learned 
much also wanted quizzes and reviews, she was apparently not aware of the 
testing implicit in the curricula and needed clearer motivation. Her faint 
praise that: "It gave me something to do", also points to a lack of motivation. 
Furthermore, she had done some programming in Basic in school and never 
truly saw the value of Logo's more general structure. Unfortunately, she 
enrolled late and her preliminary feelings aren't available for comparison with 
those of others from lior scliool (Figure 13). 

On(} prevalent opinion among students familiar with botli Logo and Simper 
was that "it's harder to do things in Simper". So most students preferred to 
work with Logo, re^^ardless of which language they started witli. Figure 14 
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The School-Teacher's Question: 

"I wish to be ... in the 8-week session of computer 
programming, being offered to junior high students with 
little or no experience with a computer or computer 
language. Tell what contacts and interests you have that 
prompt you to want to tal'o advantage of this opportunity 
and to be involved with a computer and computer 
programming lor an 8-week session." 



The Prospective Students' Responses: 

"Computers fascinate me and I really would like to learn 
some of the ways a computer can be used. I have never 
used a computer before, but I have seen people using 
computers and programming them." 

"I think it would be interesting to learn the computer 
language. I have used computers before and have enjoyed 
it very much." 

"I like math and figuring out equations and other things 
like this. I have (lone some work with computers, but 
not very much at all, and I haven't done any work with 
Logo. I would like to have some sort of career dealing 
with matlionintics, and computer programming would be 
very interesting and fulfilling." 

"My dad is a student at the ... school and talks about 
com[>utnrs and how they can solve problems. I would like 
to learn how to use them myself and also be able to talk 
'computer language' with my dad." 



Vig. Some 1974 Students' Preliminary Feelings 
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tabulates the proportion of time that students spent using Logo (and, by 
complementation, spent using Simper). Note that, within each group, students 
are ordered by pretest rank. Thus Figure 14 may be matched with Figure 10 to 
obtain further information. This convention will be observed in other figures 
in this section, whenever it is appropriate. 

In the first experiment, few students finished the Logo curriculum, so Group I 
spent negligible time with Simper (Figure 14a). But many Group II students 
went far enough with Simper to be able to start Logo, partly motivated by 
seeing their friends' work. In the second experiment, more time and a 
somewhat shorter curriculum allowed Grou.p I students to spend some time in 
Simper (Figure 14b). 

In either experiment. Group Il's^behavior shows that once students began usir.g 
Logo, they stayed with it, almost excluding further work with Simper. Figure 
14 also shows that students using Logo and Simper simultaneously (Group III), 
subject only to the stricture that Logo and Simper curriculum parts alternated, 
chose to spend most of their time with Logo (apart from one. Figure 14b third 
from bottom, who nearly excluded Logo work, spending time on a Simper 
number-guessing game). Group III an wered a capability question: students can 
learn two languages, nearly simulta:^^ "is'y, ^.nd can do so least as fast as 
students who learn the same lcnE(uag^,% vj^uentially. 

Mass preference of Logo to Simper was a desira-dc outcome in terms of the 
students' computer literacy. Although Simper provides a convenient way to 
learn and experiment with asseinbly/machine-hinguage programming, it was 
hoped that students would see the advantage of a high-level language. Indeed, 
Logo offers what mmy students seem to want: easy access to message and 
picture processing, i' offers a computationally more important feature; ease of 
phrasing complicated control strut turos. However, appreciation of this latter 
idea was usually confined to the more able students. 
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(Logo hours / Simper + Logo hours, versus pretest rank, 
"-" denotes students who took the test but not the course) 

Group I 

.99 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.98 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

l.n XXXXXXXXXXXXXXXXXaXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

.9 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

Group II 

.70 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.34 XXXXXXXXXXXXXXXXX 

.48 XXXXXXXXXXXXXXXXXXXXXXXX 

.22 XXXXXXXXXXX 

.31 XXXXXXXXXXXXXXXx 
0.0 

.17 XXXXXXXXx 

0.0 

.04 XX 
0.0 

Group III 

.82 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.09 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.64 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.87 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.67 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.69 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.68 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

.68 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

.88 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 



Fig. 14a. Breakdown of the 1 U73-Studeats' Programmin^j Time 
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(Logo hours / Simper + Logo hours, versus pretest rank) 

Group I 

.83 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.92 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.84 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.80 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

1.0 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

Group II 

.32 XXXXXXXXXXXXXXXX 

.58 xxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.61 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.18 XXXXXXXXX 

.01 X 

Group III 

.86 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX>. xxxxxx 

.68 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx 

.82 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:^ XXX 

.13 XXXXXXx 

.7 1 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 

.63 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXx 



Fig. Mb. Urealulowii of the 197'l-Stu(loiits' Programming Time 
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Bofore furtlier discussing the students' behavior, something can be said 
about the validity of the preliminary test. For Group II, Figures 14a and 14b 
indicate a strong correlation between students' ranks on the pretest and the 
time they ne ded to complete the bulk of the Simper curriculum— Pearson 
(Kendall) correlations of .9 (.8) and .6 (.4) respectively, the latter reduced frorn 
.9 (.7) because the first student could not stay in the experiment long enough. 
Students were also ranked subjectively according to final programming ability 
and dedication to the tasks presented to them in the curricula. Figures 15 and 
16 show these ratings, again by pretest rank, for all students. 

For the first experiment. Figure 15a also tabulates the mean rate of errors 
in each student's commands throughout his or her work \w\ ' \ Simper. Some 
slight, joint trend of er:'or rate and pretest rank seems evident. However, 
averaging errors in this way blurs the nature and importance of individual 
errors. Without referring to detailed protocol analysis, such a correlation 
merits little more than a "that's nice". For example, typing and reading ability 
varied greatly among the students. Furthermore, some students forged along, 
not caring how many errors they made, while others worried inordinately about 
making mistakes, particularly observed ones. Various combinations of such 
abilities and attitudes obviously can confuse simple comparisons of error rates. 
It happpns that the fourth-ranked student (Figure 15a, with a high error-rate) 
fell into the "unbridled typist" category; the third and fourth from the bottom 
(with low error-rates) were extremely careful, tending to work out commands on 
paper hofore typing them; and the fifth from the bottom had a penchant for 
typing random nuuierals, which never appeared as errors because Simper was 
perfectly happy to .store them away. Apparently anomalous error-rates often 
had explanations that bore directly upon correlations of pretest rank and error 
rate. 

Examining tlu» "mastery" and "[)orsevoran(:e" columns of Figure 15a, we al.so 
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Groups II and III (Simper data) 

("-" denotes fitudents who worked less than 3 hours) 

Rankings Rased Upon Subjective 
Evaluation of Performance 

Errors per Command Mastery Perseverance 



.06 


XXX 


1 


3 


.14 


xxxxxx 


3 


2 


.11 


XXXXx 


3 


3 


.26 


xxxxxxxxxxxx 


4 


3 


.03 


X 


2 


1 


.07 


XXx 


3 


2 


.07 


XXx 


2 


1 


.16 


xxxxxxx 


4 


1 




xxxxxxxxxxxxxxxx 


5 


4 


.23 


XXXXXXXXXXx 


4 


4 


.26 


xxxxxxxxxxxx 


5 


4 


.50 


xxxxxxxxxxxxxxxxxxxxxxxx 


5 


5 


.26 


xxxxxxxxxxxx 


4 


4 


.15 


XXXXXXx 


6 


5 


.13 


XXXXXXx 


6 


2 


.16 


xxxxxxxx 


5 


4 


.31 


xxxxxxxxxxxxxxxxx 


5 . 


4 


.27 


XXXXXXXXXXXXXx 


6 


3 



l.Oa. \i)7:\ Sinipor Students* Performance Versus Pretest Rank 
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Groups I and III (Logo data) 

("-" denotes students who worked less than 3 hours) 

Rankings Based Upon Subjective 
Evaluation of Performance 

Errors per Command Mastery Perseverance 



.16 


XXXXXXXX 


1 1 


.13 


XXXXXXx 


2 1 


.28 


xxxxxxxxxxxxxx 


2 1 


.33 


XXXXXXXXXXXXXXXXx 


3 2 


.32 


XXXXXXXXXXXXXXXX 


2 2 


.35 


XXXXXXXXXXXXXXXXXx 


4 5 


.22 


xxxxxxxxxxx 


5 5 


.26 


xxxxxxxxxxxxx 


6 5 


.21 


XXXXXXXXXXx 


2 1 


.16 


XXXXXXXX 


4 4 


.15 


XXXXXXXx 


5 3 


.24 


xxxxxxxxxxxx 


4 2 


.26 


XXXXXXXXXXXXX 


2 1 


.26 


xxxxxxxxxxxxx 


6 4 


.19 


XXXXXXXXXx 


3 2 


.28 


xxxxxxxxxxxxxx 


5 4 


.17 


XXXXXXXXx 


5 3 


.29 


XXXXXXXXXXXXXXx 


3 2 


.15 


XXXXXXXx 


4 2 



I5b. 1973 Logo Stutlonts' Performance Versus Pretest Kaiik 
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denotes stiulent -' ho -vorked less than 3 hours) 

Flaiikings Based Upon Subjective 
Evaluation of Performance 

Errors per Command Mastery Perseverance 

Groups II and III (Simper dava) 

.08 XXXX ^ 2 

.08 XXXX 2 2 

.20 XXXXXXXXXX 1 2 

.07 XXXx 1 1 

.04 XX 1 1 

.04 XX 2 3 

.04 XX 1 1 

.09 XXXXx 2 2 

.09 XXXXx 2 3 

.05 XXx 3 1 

.07 XXXx 3 2 

Groups I and III (Logo data) 

.23 XXXXXXXXXXXx 1 1 

.12 XXXXXX 1 1 

.19 XXXXXXXXXx 2 2 

.14 XXXXXXX 1 1 

.23 XXXXXXXXXXXx 2 1 

.09 XXXXx 1 1 

.21 XXXXXXXXXXx 3 3 

.19 XXXXXXXXXx 2 1 

.20 XXXXXXXXXX 3 2 

.20 XXXXXXXXXX 3 3 



Fi^. H). H)74 Students' I'cr rurinanco Vursu.s Preto.st liank 
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SCO soiDo inuUial iriMuls with pretest rank. High rankers, especially in mastery, 
tend to be above the median; low rankers below. Figure ' ""^h shows similar 
rosults for Logo students. Note, however, the lack of obvio- lal ti nd 

betwoon error rat(^ and i vnk in Figure 15b. 

Protocols provide tlie following explanations. In Groups I and III: the 
unbridled typist returns with .\ !' '^ci as the fourth-and fifth-ranked students; 
careful planners aro bottom \ from the bottom; the random-numeral 

typer is now cauglit by Logo, generating a higher rate, sixth from tlie bottom; 
and a new phenofuenon: picture-printers, fifth, tenth and eleventh from the 
bottom, who discovered )iow 'PRINT' commands could be employed in procedures 
that 'drew' therr favvM'ite things (like the "Starship Enterprise"). The latter 
three sir.ilc its made rirlatJvely fow?r errors bncause they stagnated at this point 
in the currienUnn. Stadents were never coerced to continue the curriculum. 
Rather, a wai t-and -r--e attitude was adopted, hoping that stragglers would 
eventually notice that other things, being done by other students, could also be 
inLoresting. This ta:k failed with one of these three students from the first 
experiment. 

In thn second experimfMit (Figure If)), the--:; is again little common trerd 
between error-rate and pretest rank. But again, from protocols, notable 
..exceptions can be oxi)lained. For instance, the third udent with Sirnper d .ta 
has a high error-rate because more th. i half of all his errors were made 
phiyFitHv. in rt^sixjnsr tu a naming errur-nit^ssage he received one day wheii he 
tried to save a pro|,M'ain under an illegal iianm. The middle Logo student has a 
vtM'V low rate beraus.- he aiithfjrod soviM'al \s,i\nu\^ (notably graphics ping-pong) 
whirh he and fWher:s use({ a gvoni deal, and with littlr cIkuk - for error. As in 

firsi »\vp(M-inhMit, test rank and sulijf'ctive evaluations arc correlated 
soniewhal. 
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In general, studonts Lwperimented more with Logo than they did with 
Simper, apparently because they felt more able to express t!i?ir ideas in Logo. 
This partially explains why the median error-rates in the two experiments for 
Logo students (.24 and .20) are liigher than those fcr Simper students (.16 and 
.07). An additional cause is simply that one has a wider variety of errors to 
commit in a Logo command. This had more noticeable effect in the second 
experiment (Figure IG). 'i'h.e lower overall error-rate of students in the second 
experiment also correlates with their apparently better performance on the 
I)roliniinary test (compare proportions above performance breaks in ^^'ir;ures 10a 
and 10b). More prompt and accurate tutoring also tenduii reduce the total of 
errors 

Understanding the Students, Here the central interest is, of course, the 
piocesses through^ which students learn programming. The goal being to find 
observations that .-^^hed ligl^. t on studcnf /tutor intei actions in general. The 
following results derive primarily from detailed protocol analysis, and begin 
with a sampling of the stu<hMils' initial, unfettered expectations about computers 
as ^'x pressed fir.st to Simper: 

HELLO WIIATS NEW? DO YOU WANT TO VLAY JCTTO? 

DO YOl' LIKK SUMMER? I AM FUNNY 

THIS TYPKWIHTER IS TOO SLOW SOME DOGS ARE WHITE 

WHAT IS 1^X12? HOW DO VOU WORK? 

TKACH MK iiOW TO DC) A PROGRAM HOW DO YOU KNOW? 

THICHE AH'' TWO MM.LION FLY.S IN Ai\U':RICA LET N = G 

VOU ARK V/I-:iRD, BUT SMART MY NANH'! IS ... 

CAN Vf!i; iH-:A!) AND WRITE? C:aN VOU TALK? 

Till': MAN IS CROSSING THE STREET Ai. -: VOU A CO IJTER? 

TO 1U-, )R Mi i* TO BE PRiNT MY NAMiO 

i)i:AR Ji;i>Y, THIS ("o\HuriM:R cMwXss is a lot oe fun. 

EVIOiiV nsri: IN A WIHL1-: THE C( h\H'U'I'ER GOES WACKEY! 
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then to Logo (soin/^ error mes.sa^^es arr shown --in lower case): 



HOV; ivIANY QUESTIONS CAN YOU ANSWER? 

HOW MANY WORDS DO YOU uNOW? 

COMPUTERS ARE DUMB 
computers needs a meaning 
COMPUTERS ARE ILLOGICAL 

now LONG HAVE YOU BEEN IN SERVICE? 

how needs a meaning 

YES 

y. s noods a meaning 

AKKIUMATIVE 

affirmative needs a meaning 

YES MEANS AGREED, CORRECT 

yes needs a meaning 

I JUST GAVE YOU A MEANING 

i iHM'ds n meaning 

I MiOANS //176 

i neod,s a meaning 

I GIVE UP 

ARE i .)U A LOGO OR A COMPUTER? 

I HAVE HOMEWORK TODAY, 
I HATE HOMEWORK 

I AM IN A VERY GOOD COMFMTTER CLASS BEC 
WORKING WITH Till-: COMrUTJ':R, SHE, LOGO, 



WHY ARE YOU A COMPUTER? 

THIS IS GOING TO BE VERY FUN 

tills needs a meaning 

IT MEANS IT WILL BE ENJOY/ BLE 



MY DOG IS BLACK 

THE SUNSET IS BEAUTIFUL 

PLAY CHESS 

play needs a mearing 

PLAY MEANS ' DO SOMETHING 

FUN 

fun needs a meaning 
IT'S LOGO 

ADD TWO AND FOUR 

GIVE ME AN INTRODUCTION 

I AM A VERY BADLY GOOD BOY 

AUSE IT IS A PLEASUl : 
RETYPES WHA'r VER ' WANT 



Of course, students had been encouraged to plumb Logo's and Simper^ 
"rninds", and all tlu^ above efforts received replies of no more than eithf 
'^unknown operation xxx" from Simper or "xxx needs a leaning" from Lc o. 
Interrst ingly, Lo[,^o's more understandable res{ ' .se tended to stimul ate dialogs. 
Some .^i d(MUs struck f(>i\ iii ^ously upon pri^nitive opera tions~-Si mper: 



CONtl'UTi.KS ARE FUNNY 

'ni-y i u t ,\ rf',;!.,tor, use a, b, or p 

COMMAND YOU 

'you' isn'l a r:[:ister, use a, b, or p 



{'('(Ovr i.s short for Simper's ^C'OMPAUl'^ o})oralion), and Logo: 



WMl'lRE IS GI'f^MANY,'' 
you an? not usin,;: ihv. train 
Y!':S I AM 



GET GOLF 

soniel hinj; missing,' f^"- get 
GET GAME 

s o M i( t h i n ^; : n 1 s s i n }; for g ( ^ t 

K,-: : v YOUR bn^i^MU' books now oi-rr play 

y(Air ,'t'- (Is :i iiifanini: 



soincuh in^ inLssing for get 
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YOU ARE A STUPID COMPUTEI^ 



PRINT 



* IS TIJK rOMPUTER A COMPU'I ER? 

tht» nnecls a meaning 

00 GO GO jS GIi:ORGE HOMSY A "1 OR? 
go needs a meaning gcorge need a mc^aning 

IS Mlt. HOMSY A COMPUTER? 
MAKE A SN i'Y rnr. novdn a meaning 

a needs a meaning IS IIOMSY A COMPUTER? 

honisy needs a meaning 
BREAK IT UP; YOU NASTY THING! SHUT YOUR TKRMINAL UP AND 

break GIVE ME AN ANSWER 

At tliis early /.tage, accidental discoveries of this sort usually passed 
unnoticed. Eventually most students did take notice of and exploited various 
syntactic features like mindless nror-niessages, Simper's abbre viation-by- 
trui alien, and the conunentiiig ciiaracter V~~Siniper: 

UNKNOWN OPERATION WRINKLE A 

unknown operation unknown HALLUCINATIONS 

; YOU CAN'T TALK WITH ME BECAUSE YOU ARE DUMB 
( WRP or 'HAi; select Simper's 'WRITE' or 'HALT onerations) and Logo: 

1 AM THK TURTLE THISCO?/PUTER 

i needs a meaning thiscomputer needs a meaning 

PRINT REQUEST 

' M- iWOi, IS GREAT TYPE THIS SENTENCE OVER WORD FOR WORD 

pi^INT "I DO NOT KNOW HOW TO PRINT" 

1 a.'' not know how to print 
; YOU lAKD 

IF OI^KN lo DUMB, TYPE IF NEEDS A MEANING 
o:*^! ntMHls a moaning 

Partvl:;x and prociiclion \\\^cc fii-'orlte teclmiciues that somo students used to 
"insult" tlu'ir friends. To hir^ l:..-.:ing surpi'i:;\ the lattor al)ove student's 
trit:]u'ry iu)isLt'd him <\\ I'i.s own petard. These wore healthy interactions 
h<^'Mus(^ studrMits wer*^ encouraged to keep exjx.M'i nient ation as one of thoir basic 
IfNuriini^ tools. 

In- 1. ally, fhes(^ naivp pvr inuiuM'S oftt w had a vnry high opinion of 
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. put. clonal trclitiology. It was j?:isy to show thoin that l^iglish is not yut a 
mode of communication hotwcen human and machine, hut it often took a wliilo 
for th'^ implications of this to p^Miotrate. At times, students' attempts at 
comnui.ucalion wore tied to curriculum ideas: 

RKMARK LITL:RALLY PUT A BU ' ' A 

SIMPER COMMANDS ARE FAMILIAR TO COMPUTERS LIKE SIMPER 

PRINT ••HOWCOMELOGOWORDSDONOTIIAVESPACES? 

WILL YOU WRITE ME SOME SIMPER 1 sASE 

3 4 10 ARE RELATIVE TO THE NUMi3KRS 15, 17, 29. 
IN WHAT WAY THOUGH? 
unknown operation 3 

3 fTHRKE) IS A NUMBER AND ALL COMPUTERS LIKE YOU SHOULD 
KNOW WHAT IT MEANS! 

Somt'tiiiies they became confused about curriculum instructions for giving 
commands. The following shows some examples along with the motivating 
ctu'ricul urn excerpt: 

A FEW WORDS ... type a few words and ... 

IrlNEP^EKD ... all you do is typo LINEFEED and ... 

1 TYPING 1 ... aiui ihcn typing 1 and ENTER ... 

GO TO THE SUrr,;. MARKET (r.cc Appondix 3, page 18L or 17S) 

BUY EGOS AND BACON 

FIX FUT P 2 TO V 1 RUN .. u.io FIX to cliangj* .. irom PUT P 2 

to ■ rr V I and then u:u3 IIUV p'l ... 

In fart, some stiuh^nls typ' fl Simper' - ])ro.iipL hecanse it had been shown at the 
ijf\uinninj( of ;i lino lii«\v wfT' asko to type: 

00 1: Ann A 

nnknou .} oj^or;; ' 00 I : 

Dnr stndpMt tritMl \ > ^^ot a progriun to vww by sinnilatini^^ Simper's nuiiiriu? 
mpssaj;^^: 



:>:i-:{.TrriNf; i o liso 

unknuwM <,)p.'r;i 'inn (. xeruting 
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producing an tinjoyably idiotic response. Another student, in his frustration, 
uncovered a bug; not in one of the i ntorprotors, but in the Sail compiler's 
st ruu^ runt i iru? - rou ti nes: 

,VOU STUPID COMPUTER 

'stupid' isn't a register use a, b, or p 

The bug disguised the and thus the proper erro . "unknown operation ,you". 
Once in a while, unrestrained joy of accomplishment in solving a problem would 
surface, only to be muted by an unbending parser: 

YAflOO! I DID IT! 
unknown oporation y vi oo! 
; I KNOW I KNOW 

i'i)v:ously this stiulent already knew how to protect her comments. 

"onfusions son^ctimes arose n n students worked with both Logo and 
SiM Ci* (a liu Grrup III). Logo commands cropped iip in Simper protocols and 
\'[cr - a t li ?se cases, liowever, the first or second error mo... age usually 

w -icio: to rtv,, i!ul the student of which interpreter was li t(Mung to liis 

or hor tyj)ing. In a lo'v carps, students thought tliey could re.sort to Logo 
commands wh»>n th<Mr Simper ;)rograms failed to produ':e results. This was one 
sii iple way students gave evidence of being more at ease witli the Logo 
languag'' By far tlip most common interjection of Logo commands into Simper 
protocols was in saving programs. Appar(MiMy, learning the more complicated 
Logo schcMin^ of "entries" in "files" vcrrode some students' knowledge of 
Simper's simpler filing mcthofl. 

At the very b'MM, most strdents initially thought, that a computer couJ; 
hrlp th( 1 on • p''rs()nal basis: 

[•'lUNT "AM. TMK ^ 'KKSKS ..\NI.) LKS.SUNS YOV IP VK TO OKI'I^Fl" 

Agr^MMl; that .should. <ind [i^rhafis will, ; ii-day be tli^^ CfiSv\ S»n-fM'al .students 
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discoverod Siinj/*T*.s (or 'IIKLT') coiimiaiul which printed a funeral description 
of the Simper hingua.^^t^. While this was never intended to be a necessary part 
of th<? course, it n()rietheh?ss was ex ore i sod frofjuontly by a few students. 
Curio, sity and an opon desire for aid wore attitudes to be exploited and 
encouraged. Students' were willing to (^xporiT^ont in trying to use Logo and 
Siuipev aj) information resources to help them work on ideas from the 
curriculum. 

Now, in discussing details of how studonts learned the concepts and tlie 
languages, the Simper and Logo protocol data will be treated separately. Some 
observations relating students' per for ina nee and their worl n the preliminary 
test will also be mentioned. 

Simper. Sinc^ work with nunilvrs was so much a part of these aid 
prior sciiooling, it was relativpiy ea.sy for them to accept that a ma('iiiie 
(Simper) could have a good memory lor numerals. But several had difficulty 
uiHh'rstaiiding Miat sonn* nuniorals could iiavt; special meanii.g, » tli ^r than 
jounting, to a nw?rhin'^. In the first experinieni . tiiis was a probitMii because of 
i\u} preii 'hire inti <^ ction of asseiul)ly huiguage, thus working ■^ONvr^ward from 
Englisli vatl -r tiian upward from machine language. The .ilter sequence was 
adopted ii. the second experinuMit and reduced the i: ie -nee of syntactic i'rrors 
sucli as m. It.ip).' instructions per line, making it ci(^arv;r iiia! only ti'.cee fields 
can be a.- .f'm'Wt'.l iuio one me 'H'l y . f.-ll's rnacii i ne-language numei ^vL 

Tie' ordfM ly I'X-^rnnon of .'^:Mier,iis as i instruct ions \vas still niore arjstract. 
The sho: ing-Ii.Nt example* (A) |v ndix '5, [lage 17K) and tlie iunise-to-house 
collivtion (App'-ndix 11, p.ige ')lS) faih^l io mt^Mvite ^xecuMnn for 

soiii'' sludriits. i^i'i;ranis ^^^.M^' v.rltten \/\\\\ i ii t e rspt'c.-^ci 1 "hides". de5;pite 
,d --i()i:slv scpi'-iitial r-dationsJiip h.'t'-'MMi in M'tictions on Mth*/r side ", de. 

A s.dT-des; met iiu; p!o;;;r,un used iu tie.' first rxixM-tne nt hetp-nl here (see report- 
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I), and in ilio s(M!t)n(l oxporimeiit, greiiffu' care in introducing machine language 
scMMiied to bo snff icitMit. Some of the "lu^li^y'* programming can be traced to 
Group III students who Umi iiefl to use I^ogo lino-rnnnb(n's in canonically sparse 
(10-20-30...) s.Mpunice ho[)(Hl tlie same otliting advantages wouUi accrue in 
Simper. 

In both p^M'iments, addressing values rather than stating them directly 
was difficult for many stud(Mits. One wrote his own time-telling program, knew 
what ]\i\d to hi) done to get minutes from seconds, knew sonieliiing about 
audit alj'e'uly, but typed: 

001 :TIMIO A 

00:i :DIVIDK A HO 

thf)Ugh h(^ did not int-'ud to divide by the content of location GO. The 
:urriculum section on indirect addrt^ssiiig was very helpful to those students 
who still had rouble with this conct if. Not surprisingly, tudents who \\r . 
trouble ^' ■ h the implicit nani' -value associations of the numbers-i n-bvjxes 
nrobhnn on the [)n}Iimin.iry test also had troubl ' with rcssing in Sinr r. 

The most pervasive probkMH was mastt^'ing .'^e concept of context (or 
locality of i ii fonnat ion) both from the student's point of view as a usci and 
from th(^ point of vie^v of i iis t ract i o:i ' witli ri liis or her pro; anis. The niost 
(•oinmon example of tlu^ former occurred when a stuchMit ran a program and 
'.leri(hnl th,a it needed modification. While it wa;- still running, and perhaps 
w.iiting for ;mi input (for '(JASK" oi- '.\SK'), he or she would type ;ni editing 
connnaiul . ■■.g,, 'LIST' or 'S{.' R '\'i'(Tr ), fully expe 'ting it to be obeyed. This 
rnntinuVrdit finie (^jni'usi m was seen in e -m'}" stuclent's VM)rk l-.Mst once. 

(!ont«'>:t errcM'S within pro; .aris cei 'M'ed u[Jon redunthmt or iiKMnory- 
"flni b«'[-ing" ;v^ts of instructions. For instance: 
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UOl :PIJT D 1 

002 :S'rORH B ONE 

003 :ASK A 

004 :lM;'r B 1 

005 :ST()Ili-1 I] ONE 



or 



001 :PUT B 1 

002 :STOUE B ONK 

003 :ASK B 

004 :STORE B (L>A 

005 ;PUT P ,-3 



In the first program, the contouts of register 13 and cell 'ONE' aro unnecessarily 
reset at i)0-1 and 0U5; in the second, the content of cell •QNE' is continually 
destroyed hy 'PUT P ,-3' (instead of TUT P ,--2'), This latter kind of bug was 
coininon, yo.i it had already been exploited as an example within the curricuhmi 
for tho first experiment. It was apparent that a much laore explicit treatment 
of coni: utational context was needoLl, and this -as done in the second 
expori u^nt, with mixed results. Students wh'^ Uad the most trouble with the 
candy-inarhine problem on the prc^test typically had the most trouble organizi 
tht r Simper programs. 

The most subtle way in which context affruted tlie students was in the 
relationships among the ittt. i preter, the asseuiblor and ihe mach.no. Most 
students in the first exp riment didn't fully gra<p the distinction lietween 
editing coininaiuls and ass' ciM^i'/niachine instructions. Sometimes they 
attomptpd to abhiTviaie uhe former (f\g., "SCR" for 'SCRATCirj and exi>* * I tlie 
latter to be obeyed at once. The second experiment's curriculum was modified 
to cl.j.ify these issues, vluch were founded primarily upon the confusion of 
editirar time with exfMMition time. Its better tack of introducing machine 
laiigu.ii'j: b<?foie assiMubly iarigua^^«' helped a [^r(?at deal and explicit discussions 
of ;iiiitiiiie/(Miit-linie A'pr.^ inr' No one question on the preliminary teSJ 

snt to rehue strf)n^My to this type of error. This is probably one point for 

i inprov^Manut of the tr.^t. 

Toward I'lf' end ^ rurriculnm and i:i stiuhMi: projr'cts, proc(Ml u res and 

their c;i!lnr^ s^'iurv \[d^\\ e::ainpb'.^ of how prr.;rams could be structured 

hy \vi'it,in,( f a net ion;i ! iy related sui)U' it>. In this rase, holes were ok. Success 
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hero (l(»niaii(lr(l that (ho stiuhMtt had mas tr rod tht' coiKM^pts of addr(?ssiiig aiul 
})r()f;rain control. 1 ailur(\s to stnictun^ tlu'so programs correctly wlmm? of two 
rorms: faihir(? to (h»fiiu^ a proper calling sr(|iuMi(M>, and misphic<MncMi t of the 
railing secpipnco in tlio fh)w of the program. Some inpnts to procoduro.s', 
particularly tlu' return address, wnro overlooked; oiico the call itself wus 
iiirorporat»'d as part of tlu^ pror»Mlure body. 

liecaii the first eN:[)f^ri nient, no students had time to do significant 

work on the final part of tli»' curricnhnn dealing with stacks and recursive 
procedures, the second cxprrinuMit tnalcd th<\se programming technicpies only as 
tools f use in projects (diosen hy students who had completed the formal 
curriculum. When these tools were exercised, by a f<nv students, the notion of 
context could h<^ motivated very well. IlowevtM", in either e.perimcnt, few 
.'■-tiidt'iits compl<'t.!fl the curriculum I ffnvcr st'll completed scnic proj' t. In 
passing tlirou^^li the courj.r, tht- data gradually heroines dominated by tlie work 
of tlu' more able, typicall ohhu', stndtMits. Thp remaining students simi)ly did 
not pi-oceed as far. This has undoubtedly ool )i -d hiter oi^servatioiis. 

Before dealing with inrlividual student performance, a few miscellaiu?ous 
fomm(Mits remain. Some students actively exT)loited features of the Simper 
interi)ret<M' — for in.-t.ince, truncMMon of opera ti'ni iKuues (e.g., 'STOl'' for 
\S'rOl{K' and 'LOAN' for 'LOAD'). One student o.-casir)na]ly harassed the 
ma<diine ' > i t'p.•iltedl^^ sjiving a p' ^/rani on . ; i le !' >' already existed just so 
he ecald res[)ond "no" to Sirnper'> ..arning: "a p.rogram called xxx already 
exist si c;k t.- destroy it?". The i niportanct.^ of clt?ar, r(devan; error Ciiessages 
,ils;) h.-ratii" appan.'nt (se»* 0! '.pter \ f >r exanipios). An < vamph^ follows that 
shows how mi sreading one werd can dani;erraisly altei- ihe meaning of a --ssai;. . 

SAVf: ■ 

v.'hiit yea 'A ant to name yf.uir prn^^raui? YKS 
i/k, ye.s saved 
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illustratos the rart' that must ^ i)[)liod to a[)|)ar('ntly trivial aspects of an 
interpreter. In line with earlier conuneiit.s about, contextual errors, it iihonhl be 
rnrntion<Ml that the ahovp (juestioii and the? studrMiVs t()i.;'?ther [)roduced several 
.saved programs calh^d 'S'JUATCir. 

Fij,nne 17 dis|>Iay.. ^\ir seqUf^Uvt^ in whicli Hi mp<^r-rela tnd concepts were 
learned hy each of the studiMits in the second experiment, for which tlir- best 

L.i exists. The tin. at which mastery occnrr* d war judged as outlined in 
Cba[)t<T 4, using error analysis. These laiH,Miago-relatod concepts connect with 
one or more of the gen-M-al conce[)ts outlined in 'i.ihle I, and so give an 
approxi oiiitc idea of the sequence of their mastery. 

liO^o. Students were less al)lr> to adjust to Logo'.s string manipulatic^us than 
to its more faaiiliar niunerical notation. For example, most students had 
trouble rfMnembering to f|iiote non numerical strings. Logo does not require that 
rmmm-als quoted, but demands that litoral words and sentences be quoted. 
'I'he former default ttnuled to I)** [;enerali7.od by somr to their designation of iho 
lattrr. <\spori;illy Ml flirpct commands. The spcond fxprrimpnt attnmpt'-d l.o 
clarify tluvse notatiomd T.iat'*rs, ]iit was not entirely surros.^ ; 4 l--all literals 
.11. -lid probably <pioted at first, perhaps eve/; by modifyirig Logo. 

Pro Imd not been introdue'vl early enough in the first experiment, so 

; j.se >iii(l(Mi(.. did not have a fr;uM(»work within which to execute direct 
roriini;nid.- ami tbfn add th^^in to sioied piogr.ims by editiiij^ in the second 
exr M-i r';.Mit, proc duics W(M-»? introduced early (Appendix 3, i)age IHJj) and as 
l)fdn^", i.i ♦?ssoncp, nrw hogo commands. Many stud^'Uts soon caught on to the 
valn^ ^^f bi'ini{ abi*' to con.'^truct nt^v.' and i)f'rso[ial tools, either for use or 
amu.spue'nt : 



■|'() SICIPIP :(); 
10 .SKIP 

15 sKii'iP :0: i 

KNl. 



TO V/IDL? 
ILM V *'D!AJ" 

11:1 V "DIAJ NKF!:{JS A MKANING" 

i 'on, O.K." 
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yVi)proxiiiiat(» Hours A[)pnriMit Mastery ol a Concept 

Student (hy pietcst rank, Vi\' c lOb) 

Concept I 2 4 ; 7 8 9 10 11 12 13 14 15 16 17 

AddrossiuK M 3.8 1.2 l.:.^ 1.4 1.2 5.1 - 1.3 5 1.7 - 2.3 4.1 2.4 - - 

Sucre.ssor .9 1.8 1.3 .9 1 l.L: 1.4 1.8 l.H 2.5 .9 - .9 1.2 1.7 - - 
Kxocution 

Siuiplo 3.2 n.G 8.3 2.6 4.7 3.4 3.8 - 2.8 7.5 3.7 - 4.3 7.7 5.9 - - 

('ontrol 

(usin^ :*UT') 

Doci.sions 3.9 5.8 13 3.6 5.9 3.4 2.3 - ;.3 7.1 3.4 - 5 7.7 5.9 - - 
(iisiuK MUMP'/ 
'COMPARE') 

Itoration - - - 8 8.7 7.2 7.3 - - 

Sul) -Progiiinis - C.6 - - 6.9 8.2 7.3 - 9.1 8.5 7 - 7.3 10.6 - - • 

lutornal .9 1.8 6.7 3 1.6 1.2 2.4 - 4 9.3 1.8 •> 1.5 9,1 1.7 - - 

Context 

(using storn^o) 

ILspr iMnrhino 3.2 (;.2 8.6 2.5 5.G 1.2 2.4 - L> 7.8 2.4 - 6.4 5 5.3 - - 

v'ontcxt 

('RUN'-'KDIT') 



(Bohifnce nutnbiM\s iiuliciit'^ very nccurate times, a dash signifies that a 
roiir- jt Wiis nf}Vor (IcaiP' inasti^roc]. ) 



Vi^. 17. Tiniin^^^ of 11)74 Stu(L'ntfr Masf-ry f Si nii; -m'- Rtda tc^l ('onecpts 
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TO rnv 

\i) I f S iH) 

1!0 V \y ^ M:X CANNARA is YOUIl INSTIMJCTOR DO NOT 1 RKPICAT 00 

N C('"V SOMKIiODY KI.SKS lMU)(:i':i)Uh , OH YOU WILL MM'INI) 

, ^.VM i.,)iius TUYINO TO FKUIUI': IT OUT AND AL.S(^ YOU WILL 
MA..L MK MAD!!!!!! !!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!" 

KND 



Tho first above was coiistruct<Kl by a .student when, well into the curriculum, he 

needed a way of clearing hi;- display scr< 'Mi and didn't itnow tint Logo had such 

a conunaiid ('CLEAR'). lie obviously i< - I ;i*-<' '(ly mastered itoraticju mid simph' 

recursion. Interestingly, simple (hi f : t^^) i.i'ursion came easily ii many 

students upon their first exposal ^^';' ':idix 3, page 20L), and romm( ;i 

ad-libs took the form: 

TO UIN'J Tf^ ..iOYCLE 

10 BKLL 10 P 'LinnY SHOOP" 

20 RING BICYCLE 

KND END 



TO TOM 

10 PRINT "IF TOM v AS NOT GREAT I WOULD STOP WRITING" 

20 TOM 

END 



Several pr(.)rfMlures (e.g., 'TELLTIME') tliat were used in the second exf jc-tI uhmi t 
wore incori)orate(l bccausf* students in the first experiment had done them on 
their own an i thus found tlunn interesting or useful. Sometimes early 
proeednre-wr: t ing attempted the impossible: 



TO t1':llv. :ather 
10 print weather 



In iho first cxpMi'i mnn ' , nainiiig ( n.imVvaliie ass(ni a t i '.ms) had hoen 
intrcdiKN'd via Louo's 'MAKE' ojxM'Minn, but thor*' was r»diitiv(dy little usr for 
this in Lit^M' pi'ogr/'iuniii::. In soeor. ' ivk nwu t . pi^ . 'dures wero usimI to 

int rodip'f^ (M)n{N'i)t, as namod rlnrdvs of coniiiKunls which might "veii r(';.'ive 

r. 'Ss:i:,M's - v,ilii»\^ (iiipnt.s) iinil link i]\ \]\ with int«'fn;i} namos (A])pprHliM 3, 
Logo I-;m ■ 1). 'MA. KM' uas novor m*Mili'.HitMi unless a student's projcri loi^ir.dly 
r*'f|uire(l it. 
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'l*>|)iral ♦Tiors usiiiK 'MAKM' in tlu' first <»x' fieri mon i \v(M'(»: (I) forgottinp 
([uohvs ar.iund nain«' and/or valn»', (2) cdIohs around thr naiin^ (rrasonahlo 

in vi«»vv ( f nif)st of Lo^.o's syntax, < .|;., 'MAKM ;X: "Y"' i- ''fially n^ t mdiiuj^ t.h'^ 
valiH' 'Y' to llu' !iann' 'X\ hut to tin' valu»^ already .issonatod with 'X'), (3) 
inverting nain(^ and valur positions ('MAKM SUM OF S AND H ANSWKH'), and 
(•I) linking assi;;ninpnts by oiw ronuuani! (a roasonahio expectation, e.g., 'MAICH 
'•SN()(M*\ CriAlUdl-: HKOWN" "LINUS", whaMw^ (he (auTicuIuui intended 
MAKK "SN(J()P\ CllAKIdK HUOWN'" and 'MAKK "CllARLlK HKOWN ' 
•LINUS"'). 

^* .tnin}; errors laach^ i)y stinh-ni,. in ♦^e second eNpe]'inient, where proCc>dnri-?s 
inf.odnre(i tlie (M)ueept, wric reflected hy (U:fectiv(» input correspondences and 
coutiol prohleius genfM'aterl diiring echilnj;. For (^xauiplo: (1) in[)ut -variable 
naiaes in tlu^ title . oald uo\ inatrh thos" in the jn'occdnre's body, and (2j the 
name of a procvhu'e would bo edited bn*. not then chiingcd in a rcrursiv(i cal! 
{■ a call in anoUi<-r pio edure. 

In both f»xperi i.i<>nts, initiaJ confusions about fiOgo's colon notation (i.e., 
':X:' In•^ln^ "v.ihie as:. )cia{>'d with n.une 'X'") prtKluced errors like: "PRINT 
::S:-i()(.)PV::*' (to ac^irve indirect <wldre.,si ng), an(L 'iUrrUKN PUOlJlJCr ;X: :2:' 
or 'nOUnid'l (."onfusiiai between lilt'ral:. a.:. 1 names, and betwiMMi actual 

;ind f(uio.ii .ir.iineier.-). Part of th" c()nrusion arose because Logo (lo<?s allow 
iiidirert ,iil(]re>..in)4 via repr.itrd aj)j:)lir,it ioir. A'AIvLMl" ("rr.N(;'), and it 
alhr.vs i'i:mrr.i!s 1'.' be t, unes. 

( irir ■r.ill-/. tat'eait.v 'vh'.) lia tronl^le vath I'ii" r,i ; ! niacli i le- am! niiUibers- 
ni-b;':-..- • jMid)l'-.as 'ii Ml" pr Iiininarv N'. t a' . nad lr(.abh> ,vith [jr. m-^mIu ;'e 
on ti.. !i 'ti. '['li.-' C":ie. pi ' • 'h;-.' »aiti-!.- a' .-'^Niaa! M.-^ in la-oducirig .i 

'.:.(■/. i,.,; 1. pr(H' vr .iiid. ja ; as in Siiei 'M'. is o'.l f-ailinrd U) tiv- 
[■!:;■ I : iin--'"d 1 ni" 'hi'l-iay. Oie iiu: ? al. ; 'oa-i-hM' the <(. •■; t of varial)les 
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formed in multiple or recursive procedure calls or in complicated command 
lines. The linkage is more subtle in Logo since it is managed by the 
parsing/execution stack (see Chapter 2, or report-1), and most students* 
misunderstandings showed up as soon cis they tried to solve problems requiring 
more tlian one procedure, or even more than one input to one procedure: 

TO FUNNYADD iSOMETHING: cSOMETHING: 

10 RETURN SUM FIRST :SOMETHING: FIRST :SOMETHING: 

END 

The above, when executed, e.g., by 'FUNNYADD 87 15', will not return 9 but 2 
instead, because only tlie last instantiation of ':SOMETHING:* will be on the 
execution stack when line 10 is executed. This student simply tliouglit that the 
position of a name in a title line, rather than its character content, linked it 
to a command-line input. 

The 'DOUBLE' procedure, given as an example which students were to later 
modify (Appendix 3, page 28L), provides an exemplary set of errors made by 
students early in cither experiment. Only the command line and not the title 
are shown here: 

10 RETURN MULTIPLY :X: 2 10 RETURN PRODUCT :X: :X: 

The first is a linguistic confusion: sliould an operation's name reflect its result 
(product) or its action (multiply)? The second is a very common error that 
unintentionally makes a squarer— the squaring operation itself being unknown to 
most students wlio made this error! 

Since Logo accepts "noise" words such *0F' and 'AND' (e.g., 'SUM OF 2 
AND 3*), many students expected to be able to use "BY" or "TIMES" in 
appropriate places in 'DOUBLE' or its inverse: 'UNDOUBLE'. The pros and 
cons of noise words will be discussed later. Examples of personal noise words 
and other errors made by students doing 'UNDOUBLE* follow: 
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UNDOUBLE MI^ANS TO DIVID TO UNDOUBLE IS TO TAKE HALF 

RETURN DIV 2 :NUMBER: TO UNDOUBLE :THING OF :NUMBER: 

RETURN QUO :NUMBER: :2: PRINT DIVIDE .-NUMBER: BY 2 

RETURN QUO :NUBER: iNUMBER: PRINT DIVISION :NUMBER: :NUMBER: 

RETURN QUOTIENT iNUMBER: BY 2 PRINT QUOTIENT :NUMBER: 

DIVIDED BY 2 

RETURN QUO OF iNUMBER: AND :NUMBER: BY 2 

Some classes of error already discussed appear here, namely English attempts at 
solutions, spontaneous noise words, and name/value errors. An additional 
problem is evident that concerns the stream of messages processed by Logo 
during command execution, namely: to print or return a computed value. Many 
students seemed to think that the printing on their terminal was examined by 
Logo at the same level as a command. One student believed she needed to 
comment (with V) P^^irt of a string because only its first word was a legal Logo 
operation: 

TO BY 

10 PRINT "GOODBYE; KAREN. SEE YOU TOMORROW!!" 

20 OOOUDYE 

END 

Thus students had trouble understanding that the receiver of a message 
determines its context and thus its meaning (or effect). Some were 
particularly confused and thought that they must, for example, say: 'PRINT 
UNDOUBLE 3* oven if their 'UNDOUBLE* properly contained a 'PRINT. 

The contrast between 'PRINT (or 'TYPE') and 'RETURN* was also based 
upon the execu tiou-contvol aspect of 'RETURN*— it terminates a procedure when 
executed, no matter where it appears. This was typically a problem for some 
stiidonls, who used multiple 'RETURN'S as if they were appending to the output 
message, as 'PRINT* does. Typically the sever^^ nroceduros given in the 
curriculum as exercises (Appendix 3, Part 4) had all to be done before a 
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student really soomed to iinster the basic difference between 'PRINT' and 
•RETURN'. 

In the first experiment, a problem based upon a preliminary-test question 
(the 2-colunin function-table, Appendix 2, page 128) was presented in both 
curricula. Since its command line involved one of the earl* st exposures of 
students to composition of functions, sorne attempted solutions are interesting. 
It was hoped that students would use their 'DOUBLE' procedure in the solution: 

TO RULE iNUMBER: 

10 RETURN SUM 9 AND DOUBLE :NUMBER: 
END 

But those not using 'DOUBLE' often became entangled in the mysteries of 
nested expressions, noise words and syntax in trying to produce: 'RETURN SUM 
rNUMBER: AND SUM OF :NUMBER: AND 9\ Some examples: 

RETURN SUM :NUMBER: :NUMBER: 9 

RETURN SUM :NUMBER: :NUMBKR: SUM OF 9 

SUM OF 9 TO THE PRODUCT OF :NUM: BY 2 

TO CORRESPOND 3 TO 15, 4 TO 17, AND 10 TO 29 

10 MULTIPLY :NUM: BY 2 
20 ADD 9 

10 MAKE PROD :NUMBER: AN.O 2 ANSWER 
20 RETURN SUM OF ANSWER AND 9 

TO ADD rNUMBER: 

10 RETURN SUM DOUBLE ADD 9 

The last example loops forever rs 'ADD' calls itself with 9. In the preceding 
two examples, students appeared to understand the rule but tried wriMng the 
expression on .sofjuontial command line.s, among other errors. Such attempts to 
coniniuriicate value.s implicitly across command boundaries were initially quite 
common and not related to prior work with Simper. In some cases, the 
curriculum (Appendix 3, pn^Q 18L) was one inflnonre, but most of these 
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students simply fell it was a natural way to proceed towards a solution. Again, 
misunderstanding of context usually was the culprit. 

Students were always encouraged to decompose a program into a basic set of 
related procedures. This was true for graphics projects as well (see report-1). 
One problem ('SWITCIil3', Appendix 3, page 37L) was quite effective in 
demonstrating this principle, particularly in the second experiment because of 
the earlier introduction of procedures. Errors in solving this problem and 
other, like problems involved coordinating procedure inputs, choosing operations, 
and use of the 'RETURN' command. Students who forgot to declare input 
names in the title, or used names different from those named in the title, 
found that Logo happily supplies them with the default value rather than 
complain about an undefined variable. A desirable solution was: 

TO SWITCH 13 :X: 

10 RETURN WORD THIRD :X: WORD SECOND :X: WORD FIRST :X: 

BUTFiaST BUTFIRST BUTITRST :X: 
END 

where 'SECOND' and 'THIRD' were previously written by the students to return 
the second and third letters of a word respectively. Students often failed to 
break the problem into manageable parts and thereby notice that some of the 
components had been solved previously. An acceptable solution of that ilk was: 

10 RETURN W F BF BF :X: W F BF :X: W F :X: BF BF BF :X: 
('BF' abbreviates 'BUTFIRST'; 'F', 'FIRST'; and *W', *WORD'). Actual 
attempts: 

10 RKTURN W W W F BF BF F BF F BF BF BF :W: 

TO SWITCH 13 

10 THIRD :INPUT: 

20 KIR.ST :INPUT: 

:J0 PUT THIRD FIR.ST AND FIRST THIRD 
KND 

The first exaiiipl*^ shows a common initial belief that one input can be 
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distributee! ovcm' several ope::*ations. 'i'l^^' second shows attempted inter-line 
communication, implicit 'RETURN* and English instructions. A related, simpler 
procedure, to put the fii*^*' letter in a word Insc, v/as written by one student an; 

TO REV :YIP: 

10 RETURN :IPY: 

END 

in the interesting belief ^^^^^ characters in an input's name map into those of 
its value. Because Logo defaults undeclared names, as mentioned earlier, she 
persisted with this scheme in several procedures, thinking she only had to get 
the right combination of letters to succeed. 

One frecpient error forgetting to specify all of the inputs in a direct 
command or recursive callj especially when that input does not change. One 
1973- graphics student defined the following unusual program: 

TO STliVE :BD 1? 16 48: TO BD :L: :A: :I: 

10 :BD 17 16 48: 10 FRONT :L: 

END 20 R:JHT :A: 

30 BD :L: SUM :A: :I: ;I: 

END 

She then typed *STEVPj 17 16 48', which works (in the sense that 'BD' is 
executed), because in attempting to bind the input, Logo runs 'BD' and waits 
for a value, which nevei' comes. The student did not seem to realize this, 
trying 'STEVE' v>:th a different call to 'BD\ with 'STEVE^ and 'BD' traced, 
would have helped to correct this mistake. 

Many .students had trouble understanding how procedures communicate 
values to one anotlier via *I^KTURN*. In the second experiment, for example, 
students wrote many procedures that were to return values: 

TO COMPARK :SOME: :TOY: 

10 'n:^'^ NUMHHHI' :SOME: :TOY: 

20 n'T'AI.SM luCTUHN 'TALSE'* 

30 iFTl^nJ:: KQtJAM' iSOME: :TOY: 

END 
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When constants (e.^.. "'FALSE'") were to be returned. 'RETURN' was rarely 
forgotten, but when anotlier operation/procedure was to be called to generate 
the returned value, 'RETURN' was often forgotten or assumed to be implicit, as 
in line 30 above. Several students used structures like line 30 to mean: "now 
be 'EQUALP' and do what it does"— an altempt to implicitly cliange a 
procedure's definition at runtime. 

Some projects (e.g., 'DINAR', report-1 or Appendix 2, page 127) were taken 
from the first experiment's curricula and used as part of a posttest for students 
who completed all of the second experiment's curricula. Other projects were 
used for tlie implicit testing process outlined in the tutoring discussions earlier, 
and most students added their own, especially when they W(3re able to use the 
graphics system. Some are mentioned in report-1. In the second experiment, 
for instance, one i^tudent designed a simulation of tlie game and 

another began an animated cookbool', that was supposed to implement a recipe 
visually by allowing the user to manipulate snapshots of spoons, cups, etc. 
Some of these projects are documented ii^ Appendix 4. 

As done earlier for Simper (Figure 17), Figure 18 displays the apparent 
sequence in which Logo-related concepts were learned by each of the students in 
the second experiment, for which the best data exists. A few students* work 
will be discussed in detail after some remarks about the languages and 
curricula. 
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Approximate Hours to Apparent Mas^tery of Concept 



Student (by pretest rank, Figure 10b) 

Concept 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 

Literal 1.8 1.7 1.1 1.2 1 1.4 1.7 4.2 .4 - .5 L9 .4 1 .5 .6 3.3 
Values 

Named 4.2 5.6 5.6 2.3 3 2 4.6 10 4 - 2 - - 6.1 3.1 - 4.4 
Values 

Command 4.2 2.3 5.6 4.5 3.2 2.8 4.6 11.4 4.9 - 6.4 - - 7.1 7.5 - 6.8 
Parity 

Simple 2.7 2.3 1.7 1.3 1.5 1.4 2.8 4.1 4.4 - 2.6 - 1.4 1.8 10.2 - 6.8 
Control 
(sub- 
procedure) 

Simple 4.2 6.5 9.4 7.8 4.8 2.9 5.5 11.4 4 - 7.8 - - 6.4 9.1 - 6.8 
'RETURN' 



Recursive 15.4 18.9 15.5 - - 17.6 7.9 - - 16.5 - - 28.1 - - - 

•RETURN* 

(context) 

Decisions 7.5 10.1 9.4 7.8 - 8.5 12.4 26.2 - - 9.5 - - 10.7 - - 6.8 

('IFV 

•TEST*) 



Stopping 11.6 18.1 17.1 11.4 - 15.2 7.9 - - - 11.4 - - 28.1 - - - 

Rules 

(iteration) 

User/ 3.2 2.3 5.6 1.2 4.8 1.1 2.1 3.6 1.8 - 7.8 - 1.4 2 2.6 - 1.6 

Machine 

Context 

(}3oldfaco numbers ir:licato very accurate times, a dash signifies that a 
concept was never clearly mastered.) 



Fig. 18. Timing of 1974 Students' Mastery of Logo-Related Concepts 
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Evaluation of Simper and Logo 

As a result of the experiments, various modifications were made or should 
be made to the languages. 

Simper. First targets for change have bi^en obvious bugs and 
inconsistencies in conunand evaluation and assembly. For example, after the 
first experiment, 'SCRATCH' was modified to accept the general form for an 
address-range specification (e.g., 'SCRATCH 6:8' has the obvious effect). *SAVE' 
and 'GET' were made to accept tlie name of the file as an input (e.g., 'SAVE 
GLOF^'), resorting to dialog only when such an input is lacking. A more subtle 
change was made to 'SLIDE*. One student was frustrated when his memory 
space was effectively exhausted even tliough numerous holes existed between 
program segments. So, by the second experiment, a forward 'SLIDE* (e.g., 
'SLIDE 100:200') could recursively squeeze out such holes to make formerly 
impossible relocations possible. The user is informed of which holes disappear. 
In the interest of making the name fit the action and to reduce confusions with 
Logo, 'FIX' was replaced by 'EDIT'. 

The first experiment also suggested some new operations and a new 
command. 'LEXOR' gives a decimal version of "exclusive or" (Table II), 
ERROR' tests a flag set by arithmetic overflows, 'lOT' communicates with the 
Graphics program and the plotter, and 'NEIWS' gets the system time schedule 
and any new inforTuation ahout Simper (or Logo). 'DIVIDE' was modified to set 
the 'EI.ROR' flag on division by zero, instead of the previous and unusual skip- 
if-sr re.->f''iil convention. The structure of the Simper machine itself was 
modified. Five-hundred memory cells and four registers (i.e.. A, B, C and P) 
were made standard (with upper limits as shown in Figure 2). This was 
motivated by students suggesting projects i*or which 250 memory cells were 
insufficient. The additional register was added to make procedure calls more 
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convenient, (»s|)ocially via a stiulent-proRrammocl stack. The changes wore 
achieved by a generalized restructuring of the interpreter. 

After tlie second (>x[)oriinent, more changes wore made, mostly on 
suggestions of students (see Table III). Significantly, the students were more 
concerned with improving Simper's editing ahili ■ (e.g., by adding 'FLIP') than 
with adding new powers to the simulated machine. 

Recommendations. Changes are relatively easy to make in Simpe: because 
it is written in a liigh-level language. An important improvement woula he the 
simulation of a micro-coded machine with interriipL handling, so that studontt 
could he exposed to some aspects of »iiodern macliine^;. Simulated devices otlier 
tlian the turtle (e.g., a di.sc) could also be pedagogicaily beneficial. However, 
too many "features" can be detrimental. Since a valuable computational idea is 
that problem solutio:;s can be broken logically into parts that are in turn 
reali'/.ed by certain basic and sufficient abilities of some macliine, the abilities 
chosen sliould not individually be too powerfiil. A pedagogicaily useful addition 
would be the ability to run the machine backwards as well as forwards thus to 
allow partially luuloing a computation. 

Perhaps the most beneficiari results would be achieved by making tlie 
interpreter smarter and more congenial in terms of its responses to naive 
programmers. A first step would be a structiired treatment of the 7' or TI^LP* 
command. Siiccessive applications of this command in, say, an addre.i field 
would obtain successively more detailed help about address fields. In lu^s 
respect, the interpreter would be more knowledgoaWo about itself. More general 
(and more difficult) powers, suc^^ as the ability to evaluate programs, would be 
of obvious vahie i- 'counselling »studl-n/ts. 

L(?go, In the present version of IMSSS Logo (e.\cepting Sailogo), 
substantial changes are typically difficult to make. For this type of work, the 
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intcrprotor should h.ive been witton in a higli-levc^l language (e.g., Manis, 
1973). Several changes in comniandn, apart from addition of 'uiiii*ation, wore 
made after the experiments (Table .'V). Consistency and clarity of nomenclature 
was the goal. For instance, soRiO Logo predicates mark themselves as such by 
employing the suffix "P" (e.g., 'LKSSP') and some do not (e.g., *IS'). This was a 
source of confusion for a few students. *IS', in particular, is also very 
suggestive of wrong intprj^rettUions (e.g., the line "TEST IS ;X: LESSP 0" should 
be 'TEST LESSP :X: 0'). Thus \SAMEP' was infroduced as an alternative to 
•IS*. 

Recommendations. Operation names should name the a'^tion (e.g., *ADD') 
rather than the result (e.g., 'SUM*)— or, as the precocious 9-year-old put it: "I'd 
make a whole new language without any weird commands like 'PRODUCT* and 
'REMAINDER'. Pd have MULTIPLY and FINDREMAINDER.". Predicates, 
rather than simply being suffixed with "P" should end/start with "?" (e.g., 
'LP:SS?*). If ':X:* is to be analogous to 'VALUE "X"', then nesting of colons 
should be allowed. Additionally, a different syuibol should be used instead of 
colon to delimit place holders in procedure titles, or a different, nestable 
synonym for 'VALUE' could be chosen (e.g., "@"). Numerals should be 
disallov/ed as names or always be quoted when u ;ed as literals just as text is. 
More fundamentally, value names and procedure names should use the same 
dictionary and notation (e.g., 'A' could either stand for 'VALUE "A"' or call 
procedure 'A', as in Algol 60). Pedagogically speaking, any distinctions of 
program from data should be defined by the student and not be automatic and 
pronomial notation s»^ems most natural. 

Another fundanjental point concerns oonunand evaluation. Commands for 
editinjj:, <M'asing, listing 'aid filing currently ipiote rather than evaluate their 
inpuLs (i.e., 'EDIT ROCKET' instead of 'EDIT "ROCKET"' thus disallowing 
'EDIT :R:' where 'VALUE "R"' is "ROCKET"). A consistent, flexible scheme 
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(assiiming riann\s and prorfuhirrs .sharr tho sann (ii(Mionary as suf^f^r'slpci abovj*) 
would allow or;ly 'KDIT "HOCKKT'" and 'KDIT R\ 'MDIT IIOCKKT could also 
br jillowod if tho us^m- could inalu^ his own |)roro(hir<? definitions thai cuioto or 
evahiatc inputs at will--aU in the interest of consistency, whieh is very 
important t.) naive progranuners. A fiirther simplification would resiilt if one 
operation (e.g., 'DKFINF/ or 'IIOWTO') ptn-fornied the functions of both •EUrV 
and *T0*, since tho only differenct^ is the pre-exist encc of, or lack of, u 
definition. 

Noise words (e.g., 'OF' and 'AND' as in 'SUM OF 3 AND 5') should be 
eliminated unless thoy are \inder user control. 'AND*, for instance, has a very 
strong meaning, almost erjuivalent to 'WORD*, in many students' minds: 

P SUM OF 3 AND 4 AND 5 AND 6 

Logo should emulate Lisp in returning values for all connnands and perliaps 
printing tb. se values at the top level rather than giving the message "TIIEKH 
LS NO COMMAND FOR..." when a student forgets to precede a function call 

i 

with a receiver for its reply. A nser-controll?d toggle for automatic value 
printing would be a useful debugging aid. This wouM niake 'STOP' and 'DONE' 
equivalent to 'RETURN ""', perhaps leading to their welcomed demise since 
'KXrr* really aoes what their names suggest^ tliey do. Error messages should be 
informative (e.g., "X IS ALREADY A LOGO OPE:iATION" not "X CAN'T BE A 
PROCEDURE NAME"). Misleading error messages such as "OUTPUT CAN'T liE 
USED AS AN INPUT IT DOES NOT OUTPUT" o- "OUTPUT CAN ONLY RE 
USED IN A PROCEDURE" should be avoided (tl:- former is gibberish, tlie 
latter should say something; lik. "OIJTl>UT MUST HE PRECEDED BY A LINE 
NUMBER"). I'jrror mossag*\s should not end with a unless the interpreter is 
prepared to engage the student in a helpful dialog. 

Editing and Filing. \t one t'me or another, nios. students forget to enter 
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iMlitinic iiuxli' with 'MDIT' or 'TO' when trying; to cljani^o a lim* in a prdtMuhire- - 
coinnMnils sui'h as \10 and VaY typ^Mi at Lo^'.o's top i^vri rrsiiIt«Ml in tho 

mrssa>;r.s **LINK 'li) OK WHAT PKCMIKDUKK?" and "V\)\T WHAT? YOU AUK 
NOT Dl-inNINC; ANYTIIINCV' wlurh may havr niislrd sliidi-nts into tryini; Iho 
fol lowi nj; connuands: 

KDIT IdNI-: 10 OK UNDOrni,!-: IN '('IU2 

KllASK MNK T) IN UKd'ANCrLK TO OK lUX.TANGLK 

Stiuleiits c)ft»Mi inr ImliMi r\tra worcLs (somo of which I.o^^o had iis^d in its 
own tnrssagos) with opfM'ations such a*. MIDKI" and 'IdS'l'*, ■ rif) not (>b(?y the 
j.;cncral lif)|;n I'vahiation schciJic; hrnc»\ (mtot nh'ss,';[(cs i pu/./ding. 



Knrr ro kvkni* 

yoli cari'l ('(ht thai 
KitASK :XI: 

KND 

UNDl-lKINI-: AGAIN 



LC OK Klh(-: OK MAKTA 
of can t b" a file n^onc 



KDIT :XI: 

you can't edit that 

I'lRASK TO SQUAU1-: 
erase what? 

MST AM. KILKS 
lira all wl>al? 

LIST NAMKS 

.soinclhin^ niissiriK' for list. 

LIST ALL THAT WAS OONK TODAY 
iist all wlmt? 

GKT KILK rCM.JG VOWIOLK 
file can't he a file name. 



As a cf)iivtM\ieiicp, it lai^ihl \)-' i\o!f)ful to allow sonu* default applications of 
oppiaiions lilo^ 'LIST'. K(M' in.^tam>\ wIpmi 'LIST, 'K1)1T\ 'KKASI':' or 'Hnrr 
IJr>JK xx* is l> pcd with no input, the default input would h" the name uf tho 
la; f pioc nlurr dflinctl or ♦\\»Mait<'d. Siniihirly. a ono-<'ntiy file could be gotten 
without naniini: the rnlrv. 



i h»' distin<'t i<u\ ln»^\vefMi \vha( is in Koi^ro's i tuni»'clia te '\\*'ni()iy ( \vnf \ ^paro) 
and what is on s»»^>n(lai'y stnr,i;;e rih> •.Mitfi»'s) seejus to he confiisini^ even to 
adult'-;. \\y .-ri'-iiu: .ui eiitir»* \vi m*K -j):irf' on nn "entry", it is fairly easy to *()Vi'\ 
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everything back at a later time. But since the workspace could contain the 
appended results of several 'GET's from other entries (from other people's files 
too), there is often unnecessary duplication in 'SAVE's. One should have the 
ability to save partial workspaces (groups of procedures) on entries; 

SAVE LIZ D AND UD AND SQUARE (Liz wanted to save individual 

procedures on separate entries) 

Student typing, some almost verbatim from the curriculum, occurred that 
one might expect a reasonable computer-based tutor to handle. Merely 
automating a programming curriculum by typing text at the student 
accomplishes little in dealing with such questions. Ideally a language 
interpreter should "know" about concepts and problems the curriculum is 
presenting and the intents of procedures the student is writing: 

HOW MANY INPUTS DOES "MAKE" HAVE? 

IS REQUEST A LITERAL? 
literal needs a meaning. 
NO IT DOESN'T 

HOW MANY INPUTS DOES PRINT HAVE 

IS "GEORGE" A WORD? 
The ability to answer these questions is easily given to Logo because the subject 
terminology (perhaps excepting "literal") is Logo's. 

Debuggin g. Since Logo checks pi'ocedure lines for matching quotes and 
colons at the time they are typed, it would also seem advantageous to report 
other kinds of syntax errors at "define-time" rather than at "run-time". For 
example, erron* ou numbers of inputs for primitive commands or procedures, 
and undeclar i procc uires or names (not defined globally or in the procedure's 
title) could be reported before exiting editing mode, or upon request. The 
student could act on these suggestions, editing further, or execute the partially 
defined procedure while still in editing mode, or exit to work on something 
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else. This could at least help reduce the amount of time students spend in 
discovering and correcting syntax errors one at a time. The idea of 'TRACE' 
should be expanded to allow display of command-line execution, since the 
pursuing of typically complicated commands rivals the complexity of recursive 
procedure calls. An ability to undo the last command would also be very 
helpful, as it is to LISP users. 

Implications for Curriculum Design 

In the first experiment, reports of tutors about student involvement in 
different parts of the curricula and their own projects, real or planned, led to 
changes in the presentation order of the concepts and in the techniques for 
explaining certain concepts. 

For Simper, most changes made for the second experiment centered upon 
better motivations for: context, sequential execution, addressing and assembly 
language. The machine's language of numerals would be taught before assembler 
syntax so that students would grasp the latter's reason for existence as well as 
its structure. The fact that different languages are appropriate for different 
interactions with Simper was exploited in discussing computational context. The 
intercommunication of instructions (e.g., via the registers) within programs was 
also treated in terms of context. For Logo, the first experiment demonstrated 
that procedures should be introduced early so students can create useful or 
enjoyable tools right away. 

So, for the second experiment, names were introduced first when naming 
procedures and again when naming their inputs. This definitely improved 
student interest. Decision making was also introdujed earlier in the second 
experinicnt, in both curricula. Students could embark earlier on their own 
projects, like games, some of which were used in parallel in Simper and Logo. 
Early work with deci.sion making helped the students in the second experiment 
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do better when the time came to combine it with other concepts needed, for 
instance, in general recursion with stop rules. 

In both experiments, the curriculum format (see Appendix 3) of path 
pointers, questions, problems and things to try was generally well-received by 
students. Cevlain connecting ideas or processes, such as how expressions are 
evaluated and how program execution proceeds, are difficult to sequence on 
paper. The flowchart-like diagrams with bo::es and arrows (e.g.. Appendix 3, 
page 38L) were not particularly effective. The younger children had special 
difficulty with these artifices, for the same reasons they had trouble with the 
candy-machine problem on the preliminary test. Good yet static representations 
of essentially dynamic processes are hard to come by. For Logo, the "brothers*' 
with knowledge clouds did test understanding wli^'n some of their states were 
left blank, but were of little help in mapping this understanding into a 
procedure. Good illustrations of effective metaphors are very important. 

One of the questions addressed by this work has been "what are effective 
metaphors for teaching the concepts (Table I) to naive programmers." For many 
students, the concept of a conv.ext or computational environment proved most 
difficult. In simplest form this reared itself in their confusing editing and 
execution times/languages when interacting with the Logo or Simper 
interpreters. Fresh students often gave editing commands to their running 
programs, not realizing that their programs had, in effect, taken over the 
machine and defined new Uinguages. A linguist would probably say this is a 
common problem in human languages as well. The most successful metaphor 
used in this work involves thinking about the ability of an active entity 
(machine/animal) to give its attention to some source (internal/external) of 
nie.ssages and process these messages according to some rules (language). 
Eve., jne knows what "giving attention" means to himself or herself. Linking 
this to generalizations about machines (candy/computing) is all that's needed. 
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This applies directly to explaining functions too, if they are thought of as 
translators. 

In Logo, dealing with recursive procedures that return values was difficult 
for almost all students. The above metaphor coupled with an analogy drawn to 
a chain telephone call seemed most helpful. The complication is that each 
caller must wait (on "hold" or to be called back) until the "callee'* has an 
answer to give. The success fo this tutoring device raised hopefully clearer 
alternatives to 'RETURN' such as 'REPLY' in Logo. The way in which Logo 
uses its internal pushdown stack for saving local contexts during recursion (or 
the equivalent Simper programming) links straightforwardly with the attention 
metaphor above. 

Play-acting out programs, particulary Logo, was tried in both experiments 
(e.g., Appendix 3, page 39L) with mixed results. It seemed most effective when 
used to explore command evaluation, coupled with the telephone metaphor and a 
wary likening of inputs to be instantiated to mailboxes in need of letters. For 
simple syntactic problems (e.g., how many 'WORD's to use) a little applied logic 
often produced helpful analogies (e.g., for n values use n-1 'WORD's because it 
takes n-1 dabs of glue to stick together n blocks). 

Case Studies 

The problem encountered by two second-experiment students at each point 
in each curriculum will be discussed in order to expose both their differences 
and commonalities in thought when faced with the task of learning their first 
programming languages. They will be referred to by their rank position on the 
pretost (Figure 10b) and discussed separately for two languages. 

Simper. Student fi worked relatively seriously and, from the start, 
carefully and thoroughly followed the curriculum instructions and examples. 
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She was not uncomfortable with the primitive nature of the Simper machine 
language nor with the basic commands involved in editing. Addressing and 
successor executions seemed common-sensical to her. After some brief problems 
with programs that ran off their ends or jumped to nonexistant instructions, 
she bad no further trouble with program control. Her first major project was 
tho nr j^iber-guessing game from the curriculum. She often did much of the 
work at home, bringing it the next day to try out. She made two important 
errors First, picking the number to be guessed but failing to store it in 
memory for later comparison with the user's guess. Second, using the wrong 
register in her decision-making instruction. BoLh errors can be thought of in 
terms of misappropriating the internal context of the machine at runtime. She 
also needed help in deciding that the program should pick the number before 
the user guesses. This would not matter if only one guess were to be allowed. 
Once her program was working, she used it a great deal and modified both the 
size of the numbers selected and the hints given when a guess was wrong. 

Student G went on to other work, but had saved her guessing-game and 
often recalled it to use. She worked on indirect addressing with no problems. 
The next important project involved the concept of a data-structure consisting 
of 5 characters stored in one memory cell. Again she had little difficult and 
spent time at home working on her program. When the curriculum called for a 
stop rule to be added to the program for printing 5 characters from a cell, she 
picked the correct rule with no help. She still had some trouble matching 
registers correctly in vri.it amounted to a several-instruction program. She also 
generated a contro. error by jumping too far back in her program on each loop 
circuit and re-initializing a memory cell used for counting. This class of error 
persisted in hor work for a few days. A further error in clearing memory at 
the wrong time prevented her stopping rule from functioning and her program 
ran on and on. After correcting these errors, it was obvious that her program 
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almost worked but stored only a partial result in memory— -the full result being 
in a register. She noticed this with no help and corrected the problem. A 
subsequent attempt at a similar program demonstrated that complex control, was 
still not mastered—a jump was redundantly included and a target symbol was 
placed one instruction late in the program. In addition, context problems with 
assumed register content recv.rred. The program was eventually corrected with 
help. She then went on to use the graphics system and constructed several 
iterative drawing programs without error. She then began the Logo curriculum. 

Student 14 began Simper and had difficulty immediately in understanding 
successor execution. His reaction to an erroneous program was to erase it 
rather than edit it. He was mystified by the first program in the curriculum 
because, when run, it gave no visible result until memory was displayed after 
execution. This resulted from a misreading of the curriculum instructions. As 
a result, he /.equired more than average amounts of tutoring. He had great 
difficulty understanding the need to match register names when communicating 
values among instructions. When introduced to addressing, he attempted to 
address a value by content. That is, he used an address equal to the value, not 
an arbitrary address, as desired. In doing so, liis first such program generated 
overflows by dividing by empty cells (0 values). He was helped to correct these 
problems and still preferred to erase entire programs rather than edit. In 
working on one program from the curriculum, he demonstrated a typical context 
error: typing editing commands to a running program. At this time he decided 
to review the entire curriculum. He repeated some previous errors, in 
particular, use of the wrong registers for inter-instruction communication. 
Since he was in Group III, he was also learning Logo and some Logo editing 
commands crept into his Simper interactions. His review of addressing helped 
him clear up his old confusion about content versus location. In reconstructing 
one curriculum program, he produced a control structure that jumped to a 
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wrong location. He also neglected a printing instruction even though he created 
a value in a register to be printed. Context errors from typing editing 
commands to running programs persisted. 

He made several syntax errors that indicate he doesn't really understand the 
3-field structure of Sirnper instructions. Most notable was an attempt to use 
multiple address fields to store multiple characters in a register. Again a 
control problem appeared he starte:' the guessing-game project. His program 
had a jump to a redundant instruction. His corrected program worked but 
printed out a message backwards. When translating a 'JUMP* to a 'COMPARE' 
he left in an unnecessary i^^sir^ction prior to the jun.p "-.hat prevented the 
program from operating. repeated this error twice-. Upon first exposure to 

symbols, he forgot to attach them to memory cells and so generated illegal 
addresses upon running the programs. In a later program to realize the 
function 2x+9, he used an address literally and so wrongly operated on an 
instruction in the program body, xhe data-structure program he produced 
containrd several bugs including a misaimed jump and p redundant instruction 
that is never executed. With help he tried several times, but never quite 
understood how the program vvas to function. Iteration and symbolic addressing 
remained unmastered. 

Logo. Student 6 had begun Logo after leaving Simper. She grasped 
intraprocedure control quickly but failed initially at using nested 
(sub)proceudres. Once helped she went on to create her own version of a 
simple recursive procedure to print her name. She was initially confused about 
procedures that return vaU^es and what to do with the value. She had no 
trouble with simple comrti^^^^ syntax, hut did have trouble with tlie colon 
notation denoting named values—she either neglected the colons in the command 
line or put them around constants. After a few such errors she seemed to 
understand name/value associations in Logo. A series of several procedures are 
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faced in tiie curriculum which demand successively mnrr complex command lines. 
She used *LAST' to mean "place this character last" not "take the last 
character". Commands that build strings out of parts tended to get too few 
'word's. She used the same name for bolh inputs of a 2-input procedure thus 
getting only the final instantiation when it is called. She considered 'FIRST' to 
act destructively on its input. She failed to use a building block sub-procedure 
at n opportune time. After several siring manipulating procedures she 
mastered the command sy/itax, but did not quite know when to use 'RETURN' 
appropriately. She failed to use a recursive call when it was of obvious 
necessity. She used 'RETURN'S successively, as if they append to an output 
message rather than terminate execution. She worked on the first major 
project— the guessing-game and needed help undei"standing 'BOTH'. In more 
complicated projects like 'REVERSE' she de nonstrated understanding of inputs 
and control but not quite of recuvaive 'RETURN'S which she tended to leave 
dangling so that values were fed to Logo not the calling procedure. The use of 
stop rules was no problem for her. 

Student 14 had been learning Simper at the same time as Logo. He began 
by typing literally from the curriculum (e.g., "CONTROL-N"). He retyped 
procedures rather than use edit. He attempted to elicit information from Logo 
by having it print sentences which, of course, have no meaning to Logo. He 
tended to use previous procedures' structures as solutions to new problems. He 
had trouble matching input names to procedure command lines. Prefix notation 
seemed no problem to him, but he did have trouble providing enough inputs to 
operations in command lines. He also forgot basic syntax items like line 
numbers and colons. The major project of tlie guessing game failed on first try 
bocause it tested a constant rather than a computed value. At this point he 
helped another sutdent with earlier work. After much help he had a working 
guessing game which he used alot. Some Simper commands appear. In the 
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more complicated recursive procedures he neglected not onlj' recursive returns 
but stop rules. He tended to misplace stop rules so they never got executed. 
Once they were working he enjoyed observing such procedures operate on long 
inputs under 'TRACE'. When the opportunity arose to use an already existing 
procedure as a tool in solving another problem, he rarely capitalized on it. He 
began using the graphics system and experimented with various kinds of 
pictures drawn from building block procedures he'd been given, but produced 
little original work. 

Summary 

The two students, whose work has been outlined, suggest the range of 
abilities that were present during both experiments. Some students took to the 
curricula and languages quickly and easily, while others did not. As has been 
discussed, and as Figures 17 and 18 also suggest, the. preliminary test seems to 
order students approximately on ability to complete the curricula. It also 
seems, from subjective evaluations of the studeni , to order them approximately 
on mastery. The more important question of liow students learn the concepts is 
only answerable from case-study d:ita. 

The metaphors outlined earlier seem to work becar.se they help students 
identify with the process they are trying understand. The two most common, 
virtually universal misunderstandings of all the students were: (1) 
misunderstandings of linguistic/computational context, and (2) ill-defined 
intentti. The former applying to both the storage/passing of information within 
the'r programs and their interactions with the interpreters. The latter, or 
fuzxy program specifications, amounts to wishful thinking, wherein the 
particular interpreter was expected to read tlie student's mind .lud run correctly 
evon though, for instance, a command had been left out. Leaving out recursive 
'RFirURN's, as mentioned earlier, is a typical example in which the student 
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expects the computer to be the command whose value is not returned. A brief 
categorization of all errors appears in Table XL 

In terms of the concepts originally selected as important to learning 
programming (Table I), a somewhat different ordering on difficulty for each' 
student is implied by individual case-studies, at least in the second experiment 
whose data are best. Typically, however, individual orderings approximate the 
sequence listed in Table I, with the notable exceptions of: concept 1, due to 
user/machine context errors, falls at about position 5; concepts 14, 15, and 17, 
because of internal program-management errors and common difficulty in 
starting on a reasonable program design, fall last; and concepts 5 and 9 lump 
together at position 9. 

Witli regard to progianming languages and their influence on students, the 
data strongly suggest that languages should be syntactically consistent, and 
powerful in both editing and execution capabilities. As one student said after 
her first hour with Logo: "If computers can understand languages like Logo, 
can't they understand English?" 
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Table XI 

Categorization of Observed Student Errors and Misconceptions 



Use of Language Syntax 

Prediciites difficult to master, especially combinations such as 

•EOTHV'EITHERV 
Making up nonexistent noise words analogous to Logo's. 
Misunderstanding deferred-command parsing in Logo— inputs are read 

backwards. \ 
Using infix and postfix rather than Uie Logo prefix. 
Trying to use ditto marks to copy parts of a line to next line. 
Existence jf "holes" in Simper programs. 
LitfM'al interpretation of Simper address field. 

Thinking that changi.ig (Simper) target cell's content changes all 

instruction's address fields that reference that cell. 
Forgetting to put a value in a (Simper) target cell before accessing 

it. . ■ . . 

Testing the wrong register in Simper loops. , 

Sequencing 

Not knowing any or the simplest stop condition on an iteration or 
recursion. 

Confusion between iterative and recursive techniques— input and 

return values. 
Jumping inappropriately. 
Multiple commands per line. 

Improperly communicating Simper instructions that destroy rather 
than pass on contents of registers. 

Use of Procedures 



Meaning of input values (using colon : in Logo for both constants 
and variables). 

Thinking procedure names must say what they do in order to work. 

Distributed or forgotten inputs. 

Returns from looping procedures unforeseen. 

Names of inputs not distinct or assumed to computationally lelate to 

a value (e.g., see page 93). 
Names of inputs' not the same in title and use. 

Returning Values 

Simple recursion and 'EXIT' is easy, but returning value to self is 
not. 

Procedure becomes, semantically, the value or function to be 
returned. 

Last procedure called, in series of calls, returns value for the entire 
series. 

Distinction between Logo 'DONE' and 'RETURN'. 
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IVible XI (continued) 

Storage / Memory 

Not understanding that a 'SAVE' can destroy a previously filed 
program. 

Understanding memory in Simper as read-copy/write-destroy; and 
that it is permanent until changed by a program. 

E diting Versus Runtime 

Problems editing Logo titles. 

Hard to think about runtime when editing (thinking that editing 

actually executes). 
Understanding what 'RUN' means for a program— that the machine's 

linguistic appearance to the user is redefined by the program. 

Problem Solving Methods 

Surprised that a problem can be solved or that the computer can 

carry out a certain command. 
Failure to generalize previous solutions to present problem. 
Inability to break problem solution into program steps to write. 
Multiple-line solutions rather than well-structured iteration or 

function calls. 
Failure to see minimal solutions. 

Failure to exploit the style of the programming language (such as the 
po.ssibility for extra inputs to act as ccunter or method of 
pas.sing conditional information). 
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Appendix 1 Spm 

This appendix documents the syntax and semantics of a language (Spm) 
designed by the author but never used in any experiments. It simulates a 
string-processing machine in which one operation, assignment ('ISNOW'), plays 
the central role. First, a comparison of Logo/Spm phrasing: 



Litera 

Name/value linking 
Name evaluation 
Indirect naming 
String appending 



String definitions 
(substitutions) 



Input/output 

L .belling 

Storage release 

Operation definition 
(dialogs) 

Execution call 

Recursion 



"DONALD" 

MAKE "DONALD" "DUCK" 



THING OF "DONALD" 
or just :DONALD: 

MAKE -.DONALD: "FOWL" 



WORD OF "ABC" AND "D" 



ABBREVIATE "WORD" 
AS "JOIN" 



PRINT JOIN "ABC" "D" 

line numbers as below 

automatic 

*-T0 DD :W: :C: 

010 PRINT JOIN :W: :C: 

@END 

*-DD "ABC" "D" 
ABCD 

*-T0 RECURSE 
@10 P "RECURSE" 
020 RECURSE 
0END 
^-RECURSE 
RECURSE 



[DONALD] 

©[DONALD] ISNOW [DUCK] 
or DONALD ISNOW [DUCK] 

©[DONALD] or DONALD 



@@[DONALD] ISNOW [FOWL] 
or ©DONALD ISNOW [FOWL] 

STACK ISNOW [ABC]; 
STACK ISNOW [D]; 
NEXT ISNOW APPEND; 

[PUSH] ISFOR [STACK ISNOW]; 
[DO] ISFOH [NEXT ISNOW]; 
[TYPE] ISFOR [TTY ISNOW]; 

PUSH [ABC]; PUSH [D]; 
DO APPEND; TYPE STACK; 

LAB ISNOW NEXT; DO LAB; 

FORGET LAB; 

DD ISNOW [DO APPEND; 

TYPE STACK; 

@[] ISNOW NEXT]; 

PUSH [ABC]; PUSH [D]; 
DO DD;ABCD 

RECURSE ISNOW [ 

TYPE [RECURSE]; 

DO RECURSE;]; 

DO RECURSE;RECURSE... 
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Spm Syntax. The meta-symbols and | mean, respectively, "rewrite 
' and "or". The paired meta-symbols < > ( ) and { } mean, respectively, 
non-terminal", "one of" and "optional". Spaces may be ignored. Note that 
) < > and appear both as terminal and meta-symbols: 



<program> 

<blank> 

<statement> 

<comment> 

<assignment> 

<substitution> 

<forget> 

<test> 

<literal> 

<balanced string) 
<dcstination> 

<source> 

<Iiteral name> 
<indirect name> 
<string> 
<name> 



{<blank>} {<statement> {<blank>)) ; {<program>) 

<non-printing teletype motion character) {<blank>} 

<comment> | <as.signment> | <substitution> | <forget> | 
<test> {<blank>) : {<blank>) <statement> 

<Iiteral> {{<blank>) <comment>) 

<dcstination> ISNOW (<source> | {<blank>) <literal>) 

(<destination> | <literal> {<blank>)) ISFOR 
(<source> | {<blank>} <literal>) 

FORGET <source> 

(IFEMPTY I IFNOTEMPTY) (<source> | <literal>) 
[ <balanced string> ] 

{<string>) {<balanced string>) {<literal>) {<string>) 

(<name> | <indirect name>) <blank> | 
<Iiteral name> {<blank>) 

<blank> <name> | 

{<blank>} (<IiteraI name> 1 <indirect name>) 

@ {<blank>} (<Iiteral> | <Iiteral name>) 

@ {<blank>} (<name> | <indirect name>) 

<blank> | (<nanie> | : | ; | @ ) {<string>) 

(A|B|C|D1E|F1G|H|I|J|K|L|M| 

N|0|P|Q|R|S1T1U|V|W|X|Y1Z| 

0|1|2|3|4|51G1718|9|!|"|^M 

$ 1 % I & 1 • I ( I ) 1 * I + I , 1 - I . I / I < I 

= I > I M II-) {<name>) 
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Semantics. The Spm machine consists of (a) a processor, which interprets 
strings in the Spm language defined above; (b) an arbitrary number of memory 
cells, each capable of storing a balanced string of arbitrary length; and (c) two 
pushdown stores called 'STACK' and 'NEXT', each consisting of an ordered set 
of memory cells of which only that cell bearing the name of the set is 
immediately accessible. New memory cells are created as needed to satisfy 
assignments. Any existing accessible cells, except 'STACK' and 'NEXT', can be 
released. The Spm machine also maintains an inaccessible and variable stock of 
cells for satisfying 'ISFOR* statements and 'STACK' and 'NEXT' manipulations. 

Certain strings have special meaning to the Spm machine as names, 
primitive operations. Names which Spm automatically associates with specific 
memory cells are: 'TTY', 'STACK' and 'NEXT'. Other names are defined by 
the execution of assignments. All accessible cells must necessarily have distinct 
names. "Spm operations are predefined names which cause specific activities of 
the machine when it encounters them during the e.xecution of statements. 
•ISNOW, 'ISFOR', 'FORGET', 'IFEMPTY', 'IFNOTEMPTY', '©', Vi V and ']' 
have such effect. The two pushdown stores, whose accessible cells are named 
'STACK' and 'NEXT', have special properties: (a) if either 'STACK' or 'NEXT' 
appears as the destination in an assignment, the machine attaches a new cell to 
the accessible end of the appropriate ordered set of colls. The new cell is loaded 
with the value of the source and the name 'STACK*, or 'NEXT' as appropriate, 
is associated with this new cell rather than with the previously accessible cell; 
(b) if either 'STACK' or 'NEXT' occurs as a source in an assignment, a 
substitution or a <forget>, the Spm machine uses the accessible cells's content, 
and release^, the cell. The name 'STACK' or 'NEXT', as appropriate, is then 
associated with the next cell in the corresponding ordered set of cells. The 
same action results when either 'STACK' or 'NEXT' appears as a destination in 
a substitution statement; (c) no change in the structure of 'STACK' or 'NEXT' 
is made if either appears as a source in a test. 
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Spm Primitives 

Symbols Operations 

NEXT ISNOW 
STACK ISFOR 
TTV FORGET 
IFEMPTY 
IFNOTEMPTY 
APPEND 
HEAD 
TAIL 
AFTER 
@ 



c 
] 

'NEXT' always contains the string to be executed next by the Spm machine. 
The machine obtains one statement after another from this string by scanning 
the vab:e of 'NEXT from left to right until a not part of a literal, is 
encountered. The scanning process removes all characters up through the V 
frcm 'NEXT', shortening its content as execution procedes. When the last 
stat'^noit in 'NEXT' has been executed, the current cell is released and replaced 
by that directly beneath it. Should 'NEXT' ever be exhausted of cells, the Spm 
machine will automatically attempt to fill 'NEXT' with characters from the 
teletypewriter ('TTY'), If a statement cannot be executed, the machine prints a 
message and again goes to the teletypewriter for input. Note that this is 
analogous to execution of the statement 'NEXT ISNOW TTY'. 'STACK' is the 
accessible cell in the general pushdown store and may have as value any string. 
'TTY' is the user's terminal. Assignment to it causes the assigned value to be 
printed. Assignment from it to a destination obtains characters from the 
typist. Its value is not maintained by Spm, so characters disappear on the way 
in or out as typing proceeds at the terminal. Its value is '[]' when input or 
output has been completed. 

'ISNOW' is the means for changing the content of the Spm machine's 



Page 123 

memory. When a name is used for the first time in an assignment, the 
machine obtains a new cell in which to store the assigned value and associates 
the name with this cell. 'ISFOR' is a simple symbol/string substitution 
mechanism. After it is executed, the Spm machine will automatically substitute, 
for any occurrences of tlie value on the left of the 'ISFOR' in the text of any 
statement scanned from 'NEXT', the value on the right. Tliis amounts to a 
simple transformation of the Spm language to suit the user. Recursive 
substitutions are not allowed. 'FORGET' is the means for releasing names and 
their associated memorj^ cells from the Spm machine's memory. 

'IFNOTEMPTY' and 'IFEMPTY' are tests which, if the value tested is not 
*[]' or is '[]', respectively, will execute the subsequent statement. Otherwise, the 
statement is skipped. 

'APPEND' joins a character to the end of a string. The character is 
assumed to be in the top cell of 'STACK*, with the string immediately beneath. 
It returns the resultant string as the value of 'STACK'. If a string is used for 
the character, only its first character will be appended. 'HEAD' accents a 
string in 'STACK' and returns the first character of that string in 'STACK'. 
'TAIL' is like 'HEAD', but returns all characters in the string after the first is 
removed. For 'AFTER', 'STACK' and the cell beneath it each contain a 
character. If the character in 'STACK' occurs before the other character in the 
lexicographical ordering defined for the characters of the Spm alphabet, the top 
character is removed from 'STACK'. Otherwise, both 'STACK' cells are removed 
and the value of '[]' given to 'STACK'. If strings are supplied as values, only 
the first character of each will enter into the comparison. 

*©' indicates that the value of the string which follows should be 
interpreted as a name. Note '@[A13C]' and 'ABC* are equivalent. ';' terminates 
an Spm statement. ':' indicates the beginning of a statement in a test. '[' and 
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*]' respectively denote the 5)tart and end of a literal. Note that and *]' must 
occur in pairs according to the syntax. There is no legal way to obtain either 
bracket singly in a piece of executable text. They may be obtained from '[]' 
liowever, with the 'HEAD' and 'TAIL' functions. Some details of Sprn phrasing 
follow: 



String constant 

Empty string 

Assignment 

Name evaluations 

Recursive naming 
(unlimited indirect 
addressing) 

Using 'STACK* 
(produces): 



Using 'NEXT 
(program control, 
produces): 



Substitutions 
ISNOW]; 



Input/output 
(types out "ABCD") 

Storage release 

Operation defining 

Execution 

(types out "ABCD") 
Recursion 

Stack release 
Premature return 



[DONALD] (literal) 
[] 

©[DONALD] ISNOW [DUCK] or DONALD ISNOW [DUCK] 
0[DONALD] or just DONALD both have the value DUCK 
00[DONALD] ISNOW [FOWL] or @DONALD ISNOW [FOWL] 



STACK ISNOW [ABC]; STACK ISNOW [D]; 
+ + 

I D |<- STACK 
+ + 

I ABC I 
+ + 

NEXT ISNOW APPEND; TTY ISNOW STACK; 

+ + + + 

I TTY ISNOW STACK j<-' NEXT | ABCD |<-- STACK 
+ + + + 

[PUSH] ISFOR [STACK ISNOW]; [DO] ISFOR [NEXT 
[TYPE] ISFOR [TTY ISNOW]; 

PUSH[ABC]; PUSH[D]; DO APPEND; TYPE STACK;ABCD 
FORGET DONALD; 

DD ISNOW [DO APPEND; TYPE STACK;]; 
PUSH [ABC]; PUSH [D]; DO DD;ABCD 

RI'XUHSK ISNOW [TYPE [ABCD]; DO RECUHSE;]; 
DO Rl-:CURSE;ABCDABCDABCDAnCD.., 

0[] ISNOW STACK; 

G][] ISNOW NEXT; 
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Appendix 2 Aptitude-Testing Details 

An Example of Commercial Test Evaluation 

The example derives from remarks in the published manual for one of the 
programming tests examined. The validity of that test was assessed by three 
studies: (i) correlation of test scores and grades of three groups of 
programming trainees, (2) correlation of test scores and overall performance 
ratings by supervisors of programmers, and (3) a study like that c ^ (2) in 
which grades on a training course were also available. Studies (1) and (3) both 
assumed, without discussion, tliat the testing done during training was itself a 
valid measure of programming ability. Studies (2) and (3) both assumed that 
ratings by superiors were similarly valid. Study (IJ indicated that, of fifteen 
relevant correlations between subtest scores and trainee groups, eight were of 
statistical (normal theory) significance. And only one subtest was significantly 
correlated with trainee performance over all groups, in spite of tlie fact that 
the overall test/training correlation for each group was significant. 
Interestingly, the most variable subtests were those which relied heavily on time 
and repetition. In Study (2), three of five subtest correlations and the overall 
correlation were significant but small; and the two remaining subtests were 
those which exhibited variable or minimal correlation with performance in 
study (1). Unfortunately, the ratings used as the validating measure in (2) were 
not confined to programming ability and included such things as attitudes. 
Therefore, study (2) is invalid. Study (3) found three subtests significantly 
correlated with training course grades, but one of the three had not been 
si-'nificantly correlated with grades for any group in study (1). Furthermore, 
t\e ratings used in the other half of study (3) were virtually uncorrelated with 
subte.-t results. The brochure went on to state that these ratings and job 
tenure were correlated more strongly than anything else in both halves '-^ the 
study— the suggestion being that low correlations must be expected wl; . 
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evaluations place high value on rolativ(ily invalid properties (i.e., tenure). An 
alternative obscrvition can bo made which applies to any correlational 
procedure: the .sample variance of a measured property may be «o low that 
apparent but spurious correlations with another measure arise. In study (3), 
the test scores could have had low variability for good reason: the testees could 
have been of very nearly the same competence. In any event, none of the 
studies provided a clear validation of this particular test for programming 
aptitude. 

1974 Test Questions 



The pl*»r and post-tests given to studeixt^fn the second experiment are 
presented here, ooginning on page5-r?7and 131 respectively (some of the 
questions are specificaUyv^^^T^^ to in the text). All students in that 
experiment worke^Mlie pretestT^-^liiU^ a few, who finished both the Logo and 
Simper curj?i^ula, worked the posttestXJ^ie questions in these tests were drawn 
fronv^ie same set used to construct the 197T experiment's pretests and so 
reflect their content as well. 
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